-- Logs begin at Sun 2022-08-07 18:37:48 UTC, end at Sun 2022-08-07 19:46:01 UTC. -- Aug 07 19:17:33.861843 dv-cinder-850320-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 19:17:33.871007 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 19:17:33 2022] *** Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: nodename: dv-cinder-850320-4-iscsi Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: machine: x86_64 Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: clock source: unix Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: pcre jit disabled Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: detected number of CPU cores: 4 Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: current working directory: / Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: detected binary path: /usr/bin/uwsgi-core Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: your processes number limit is 47680 Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: your memory page size is 4096 bytes Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: detected max file descriptor number: 2048 Aug 07 19:17:33.873067 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: lock engine: pthread robust mutexes Aug 07 19:17:33.874023 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: thunder lock: enabled Aug 07 19:17:33.874023 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 19:17:33.874023 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 19:17:33.911975 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: Python main interpreter initialized at 0x55cb0c0ef9c0 Aug 07 19:17:33.911975 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: python threads support enabled Aug 07 19:17:33.911975 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: your server socket listen backlog is limited to 100 connections Aug 07 19:17:33.911975 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: your mercy for graceful operations on workers is 90 seconds Aug 07 19:17:33.912377 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 19:17:33.912377 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: *** Operational MODE: preforking *** Aug 07 19:17:33.912638 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: *** uWSGI is running in multiple interpreter mode *** Aug 07 19:17:33.912638 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: spawned uWSGI master process (pid: 103158) Aug 07 19:17:33.912843 dv-cinder-850320-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 19:17:33.913362 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: spawned uWSGI worker 1 (pid: 103159, cores: 1) Aug 07 19:17:33.913665 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: spawned uWSGI worker 2 (pid: 103160, cores: 1) Aug 07 19:17:33.913826 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 19:17:34.586845 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 19:17:34.600860 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 19:17:35.650860 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:17:35.650860 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: from cryptography.utils import int_from_bytes Aug 07 19:17:35.651504 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:17:35.651504 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: from cryptography.utils import int_from_bytes Aug 07 19:17:35.673593 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:17:35.673593 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: from cryptography.utils import int_from_bytes Aug 07 19:17:35.674103 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:17:35.674103 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: from cryptography.utils import int_from_bytes Aug 07 19:17:38.090179 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 19:17:38.090769 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 19:17:38.090923 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 19:17:38.091298 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 19:17:38.091509 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 19:17:38.091898 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 19:17:38.091984 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 19:17:38.092107 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.092310 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.092446 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 19:17:38.092529 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.092653 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 19:17:38.092874 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.093028 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 19:17:38.093202 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.093350 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.093479 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.093582 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.093813 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.093956 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.094124 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.094272 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.094447 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.094585 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.094674 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.094817 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.094956 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.095169 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.095305 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-4-iscsi {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.095462 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.095560 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.095801 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.095893 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.096088 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.096202 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.096407 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.096498 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.096730 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-4-iscsi {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.096831 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.097049 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.097157 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.097343 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.097441 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.097642 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.097832 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.098101 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.098317 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.098472 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.098610 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.098773 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.098912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.099056 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.099193 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.099473 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.099660 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.099808 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.099952 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.100132 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.100271 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.100414 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.100559 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.100701 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.100846 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.100983 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.101117 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.101325 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.101494 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-4-iscsi {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.101635 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.101770 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.101908 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.102043 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.102231 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.102368 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.102537 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.102645 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.102931 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.103124 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-4-iscsi {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.103209 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.103290 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.103530 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.103633 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.103844 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.103929 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.104169 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.104284 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.104496 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.104593 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.104802 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.104895 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.105114 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.105200 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.105427 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.105513 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.105723 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.105810 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.106026 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.106121 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.106326 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.106420 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.106637 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.106724 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.106959 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.107058 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.107232 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.107318 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.107476 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.107616 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.107777 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.107932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.108117 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.108280 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.108432 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.108588 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.108751 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.108893 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.108987 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.109145 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.109239 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.109457 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.109596 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.109779 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.109873 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.110098 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.110196 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.110398 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.110497 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.110659 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.110751 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.110910 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.111034 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.111227 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.111315 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.111548 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.111642 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.111844 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.111929 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.112166 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.112266 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.112477 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.112593 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.112783 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.112868 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.113097 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.113190 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.113404 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.113495 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.113771 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.113866 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.114105 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.114192 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.114391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.114476 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.114693 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.114788 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.115026 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.115113 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.115334 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.115419 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.115634 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.115727 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.115946 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.116075 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.116286 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.116384 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.116587 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.116683 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.116889 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.116975 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.117185 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.117272 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.117496 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.117590 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.117824 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.117964 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.118123 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.118242 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.118372 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.118477 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.118668 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.118763 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.118970 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.119063 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.119280 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.119367 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.119579 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.119707 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.119876 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.119964 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.120196 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.120285 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.120489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.120574 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.120789 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.120876 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.121088 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.121174 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.121387 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.121473 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.121684 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.121775 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.121982 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.122075 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.122279 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.122365 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.122580 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.122677 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.122878 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.122964 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.123175 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.123272 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.123480 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.123576 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.123786 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.123874 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.124105 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.124194 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.124406 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.124505 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.124705 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.124794 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125003 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125095 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125315 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125409 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125615 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125711 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.125997 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.126214 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.126308 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.126510 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.126594 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.126807 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.126900 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.127117 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.127292 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.127417 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.127504 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.127716 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.127802 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.128044 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.128150 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.128340 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.128444 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.128642 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.128744 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.128953 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.129047 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.129279 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.129367 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.129577 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.129662 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.129874 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.129971 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.130171 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.130266 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.130466 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.130552 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.130763 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.130850 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.131056 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.131150 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.131349 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.131442 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.131640 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.131737 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.131950 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.132061 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.132287 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.132374 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.132589 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.132724 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.132887 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.132972 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.133183 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.133281 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.133486 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.133572 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.133807 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.133894 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.134129 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.134223 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.134439 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.134532 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.134748 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.134834 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.135053 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.135148 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.135374 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:17:38.135461 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.135684 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.135768 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.136068 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.136172 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.136320 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.136408 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.136639 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.136724 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.136943 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.137037 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.137249 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.137336 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.137555 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.137642 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.137867 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.137954 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.138179 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.138272 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.138499 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.138594 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.138816 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.138902 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.139123 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.139229 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.139436 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.139530 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.139739 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.139825 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.140068 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.140158 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.140476 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.140573 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.140806 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.140893 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.141111 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.141200 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.141444 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.141621 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.141783 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.141963 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.142090 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.142287 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.142406 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.142620 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.142726 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.142945 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.143038 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.143266 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.143358 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.143618 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.143775 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.143915 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.144057 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.144272 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.144371 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.144577 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.144664 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.144982 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.145076 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.145289 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.145375 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.145595 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.145683 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.145898 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.145983 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.146202 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.146302 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.146507 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.146600 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.146837 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.146923 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.147146 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.147240 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.147453 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.147539 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.147759 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.147853 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.148094 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.148196 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.148402 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.148490 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.148712 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.148802 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.149016 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.149112 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.149315 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.149402 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.149611 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.149705 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.149907 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.150036 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.150207 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.150302 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.150503 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.150589 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.150820 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.150910 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.151135 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.151220 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.151434 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.151520 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.151736 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.151823 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.152068 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.152207 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.152370 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.152461 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.152670 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.152756 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.152969 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.153054 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.153267 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.153353 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.153572 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.153660 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.153874 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.153960 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.154170 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.154264 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.154484 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.154590 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.154785 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.154879 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.155083 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.155180 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.155398 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.155489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.155692 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.155778 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.156009 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.156112 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.156314 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.156408 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.156616 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.156702 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.156919 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.157014 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.157222 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.157307 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.157523 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.157615 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.157838 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.157933 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.158139 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.158232 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.158440 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.158525 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.158751 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.158838 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.159062 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.159149 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.159366 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.159450 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.159676 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.159762 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.160010 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.160144 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.160320 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.160434 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.160680 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.160771 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161016 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161110 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161315 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161410 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161614 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161702 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161910 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.161995 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.162210 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.162305 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.162506 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.162592 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.162803 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.162900 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.163101 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.163199 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.163399 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.163494 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.163697 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.163787 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.164026 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.164116 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.164331 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.164419 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.164626 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.164712 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.164920 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.165007 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.165214 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.165309 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.165518 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.165607 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.165826 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.165913 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.166151 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.166237 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.166461 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.166582 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.166767 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.166862 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.167071 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.167158 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.167375 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.167471 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.167719 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.167807 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.168053 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.168169 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.168359 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.168464 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.168673 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.168760 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.168979 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.169069 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.169293 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.169393 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.169597 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.169683 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.169912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.169998 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.170215 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.170309 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.170530 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.170617 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.170833 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.170927 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.171144 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.171243 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.171440 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.171525 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.171748 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.171835 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.172093 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.172216 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.172411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.172544 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.172738 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.172854 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.173066 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.173154 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.173391 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.173477 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.173700 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.173793 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.174020 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.174107 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.174325 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.174410 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.174630 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.174725 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.174929 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.175018 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.175240 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.175327 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.175543 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.175645 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.175850 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.175943 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.176277 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.176380 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.176595 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.176690 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.176899 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.176987 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.177214 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.177300 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.177511 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.177605 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.177814 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.177900 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.178135 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.178222 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.178443 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.178613 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.178756 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.178841 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.179061 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.179191 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.179375 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.179471 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.179679 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.179764 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.179980 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.180148 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.180306 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.180393 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.180607 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.180693 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.180907 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.181000 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.181564 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.181658 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.181872 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.181957 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.182175 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.182267 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.182476 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.182567 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.182773 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.182860 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.183081 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.183173 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.183384 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.183471 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.183684 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.183771 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.183979 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.184096 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.184303 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.184391 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.184612 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.184697 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.184912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.185009 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.185223 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.185308 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.185531 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.185623 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.185827 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.185927 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.186123 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.186209 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.186429 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.186522 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.186727 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.186820 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.187021 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.187116 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.187317 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.187404 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.187613 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.187706 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.187944 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.188050 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.188270 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.188357 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.188568 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.188656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.188878 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.188970 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.189178 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.189266 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.189476 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.189562 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.189779 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.189872 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.190076 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.190162 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.190376 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.190469 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.190689 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.190776 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.190993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.191092 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.191292 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.191377 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.191594 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.191680 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.191916 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.192039 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.192246 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.192332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.192548 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.192641 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.192861 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.192957 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.193160 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.193246 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.193461 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.193548 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.193763 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.193867 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.194059 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.194145 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.194361 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.194446 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.194667 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.194753 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.194990 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.195238 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.195325 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.195563 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.195657 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.195868 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.195963 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.196204 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.196292 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.196515 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.196612 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.196824 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.196910 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.197142 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.197407 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.197493 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.197743 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.197829 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.198059 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.198154 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.198359 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.198444 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.198661 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.198756 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.198956 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.199049 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.199258 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.199344 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.199555 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.199649 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.199852 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.199938 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.200176 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.200277 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.200477 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.200563 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.200773 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.200859 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.201069 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.201155 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.201364 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.201458 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.201661 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.201747 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.201967 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.202053 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.202261 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.202434 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.202563 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.202649 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.202858 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.202944 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.203169 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.203263 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.203467 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.203553 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.203761 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.203853 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.204077 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.204180 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.204373 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.204460 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.204707 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.204793 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.205003 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.205089 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.205324 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.205415 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.205634 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.205721 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.205940 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.206027 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.206244 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.206330 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.206536 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.206629 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.206850 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.206937 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.207149 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.207235 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.207527 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.207615 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.207825 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.207912 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.208160 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.208250 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.208462 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.208559 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.208761 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.208854 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.209065 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.209159 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.209366 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.209465 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.209668 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.209760 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.209965 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.210051 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.210258 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.210352 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.210556 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.210695 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.210849 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.210973 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.211157 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.211289 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.211456 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.211601 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.211751 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.211916 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.212066 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.212253 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.212368 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.212557 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.212703 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.212868 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.212968 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.213177 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.213263 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.213496 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.213581 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.213805 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.213900 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.214096 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.214193 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.214392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.214478 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.214684 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.214780 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.214982 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.215076 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.215281 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.215367 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.215574 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.215661 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.215880 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.215965 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.216204 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.216322 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.216499 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.216604 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.216794 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.216880 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.217091 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.217220 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.217386 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.217480 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.217681 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.217766 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.217980 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.218067 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.218293 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.218379 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.218603 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.218687 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.218895 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.218986 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.219193 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.219286 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.219488 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.219576 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.219782 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.219877 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.220101 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.220198 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.220405 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.220503 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.220700 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.220795 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.220995 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.221088 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.221290 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.221376 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.221583 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.221677 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.221879 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.221966 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.222191 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.222276 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.222488 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.222573 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.222784 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.222869 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.223114 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.223200 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.223410 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.223496 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.223718 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.223802 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.224045 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.224143 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.224357 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.224445 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.224680 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.224764 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.224989 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.225075 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.225292 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.225378 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.225596 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.225681 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.225897 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.225990 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.226204 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.226297 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.226500 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.226587 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.226808 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.226902 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.227111 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.227204 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.227416 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.227503 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.227711 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.227806 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.228021 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.228115 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.228339 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.228425 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.228646 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.228749 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.228948 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.229033 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.229259 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.229346 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.229569 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.229661 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.229880 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.229972 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.230176 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.230261 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.230476 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.230573 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.230772 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.230852 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.231070 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.231157 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.231371 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.231457 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.231671 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.231756 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.231973 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.232123 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.232296 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.232383 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.232600 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.232694 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.232904 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.232991 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.233204 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.233291 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.233500 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.233596 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.233799 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.233895 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.234098 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.234184 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.234393 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.234489 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.234703 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.234797 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235001 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235087 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235297 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235383 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235595 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235689 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235889 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.235976 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.236215 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.236313 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.236509 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.236604 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.236815 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.236943 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.237142 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.237249 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.237453 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.237547 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.237758 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.237852 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.238069 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.238155 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.238374 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.238461 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.238781 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.238869 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.239089 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.239183 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.239411 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.239532 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.239821 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.239910 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.240153 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.240252 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.240461 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.240549 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.240764 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.240852 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.241063 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.241157 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.241360 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.241447 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.241663 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.241749 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.241964 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.242056 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.242260 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.242382 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.242556 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.242698 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.242851 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.243015 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.243164 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.243327 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.243463 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.243651 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.243775 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.243937 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.244207 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.244295 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.244512 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.244608 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.244810 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.244897 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.245157 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.245242 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.245460 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.245546 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.245782 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.245869 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.246087 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.246173 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.246396 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.246480 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.246711 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.246797 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.247006 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.247099 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.247313 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.247409 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.247615 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.247798 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.247931 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.248128 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.248275 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.248459 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.248580 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.248741 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.248883 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.249061 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.249178 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.249385 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.249495 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.249689 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.249806 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.250001 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.250110 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.250310 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.250420 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.250636 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.250828 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.250958 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.251140 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.251270 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.251442 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.251584 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.251758 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.251891 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.252106 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.252239 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.252406 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.252565 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.252700 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.252880 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.253009 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.253205 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.253302 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.253568 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.253654 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.253878 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.254009 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.254220 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.254319 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.254525 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.254612 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.254825 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.254911 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.255122 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.255217 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.255417 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.255503 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.255713 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.255799 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.256045 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.256147 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.256345 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.256432 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.256656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.256742 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.256960 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.257047 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.257279 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.257372 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.257582 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.257669 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.257876 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.257964 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.258187 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.258272 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.258481 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.258566 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.258776 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.258865 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.259069 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.259155 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.259363 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.259448 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.259690 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.259776 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.259982 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.260130 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.260312 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.260460 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.260638 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.260725 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.260953 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.261040 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.261257 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.261356 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.261559 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.261646 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.261864 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.261957 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.262166 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.262266 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.262475 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.262561 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.262790 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.262876 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.263085 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.263185 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.263378 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.263466 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.263682 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.263768 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.263975 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.264143 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.264287 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.264373 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.264579 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.264693 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.264878 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.265011 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.265171 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.265332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.265481 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.265661 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.265763 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.265967 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.266061 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.266271 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.266357 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.266580 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.266680 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.266883 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.266981 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.267186 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.267273 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.267481 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.267566 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.267777 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.267863 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.268102 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.268202 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.268409 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.268497 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.268711 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.268798 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.269010 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.269096 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.269323 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.269412 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.269627 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.269740 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.270025 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.270120 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.270332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.270418 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.270634 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.270727 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.270934 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.271033 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.271238 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.271322 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.271543 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.271630 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.271841 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.271935 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.272171 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.272271 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.272480 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.272574 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.272787 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.272882 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.273117 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.273434 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.273520 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.273749 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.273836 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.274066 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.274149 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.274370 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.274454 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.274676 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.274771 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.274982 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.275075 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.275287 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.275377 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.275589 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.275688 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.275893 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.275979 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.276224 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.276476 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.276563 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.276813 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.276902 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.277130 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.277216 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.277444 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.277539 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.277757 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.277843 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.278073 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.278158 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.278379 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.278475 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.278685 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.278773 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.278989 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.279075 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.279300 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.279405 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.279613 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.279707 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.279912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.280031 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.280244 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.280332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.280551 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.280637 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.280856 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.280944 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.281160 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.281249 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.281462 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.281548 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.281762 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.281857 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.282064 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.282151 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.282364 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.282451 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.282662 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.282757 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.282965 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.283070 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.283268 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.283384 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.283588 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.283699 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.283912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.284017 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.284249 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.284336 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.284554 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.284641 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.284857 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.284951 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.285162 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.285256 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.285577 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.285715 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.285890 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.286021 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.286205 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.286345 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.286518 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.286661 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.286841 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.286975 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.287179 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.287276 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.287501 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.287587 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.287814 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.287908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.288149 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.288251 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.288465 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.288553 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.288771 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.289000 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.289087 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.289317 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.289405 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.289650 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.289742 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.289952 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.290039 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.290247 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.290340 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.290555 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.290642 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.290855 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.290951 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.291192 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.291387 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.291521 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.291730 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.291821 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.292070 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.292161 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.292389 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.292476 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.292692 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.292778 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.292999 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.293093 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.293295 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.293432 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.293605 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.293700 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.293898 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.293985 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.294194 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.294280 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.294502 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.294741 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.294829 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.295085 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.295171 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.295381 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.295467 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.295681 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.295768 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.295979 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.296150 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.296297 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.296384 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.296597 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.296685 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.296891 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.296978 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.297210 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.297305 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.297508 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.297594 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.297804 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.297890 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.298101 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.298266 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.298405 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.298492 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.298700 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.298786 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.298993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.299088 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.299288 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.299375 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.299583 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.299669 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.299888 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.300005 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.300205 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.300326 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.300503 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.300592 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.300799 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.300894 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.301198 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.301288 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.301498 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.301620 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.301799 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.301886 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.302095 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.302182 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.302403 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.302489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.302697 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.302784 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.303004 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.303097 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.303319 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.303405 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.303624 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.303711 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.303935 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.304067 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.304266 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.304365 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.304569 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.304655 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.304870 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.304956 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.305180 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.305275 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.305484 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.305732 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.305819 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.306059 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.306509 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.306733 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.306820 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.307061 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.307149 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.307384 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.307471 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.307683 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.307770 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.307981 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.308085 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.308303 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.308399 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.308619 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.308707 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.308921 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.309007 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.309224 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.309495 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.309583 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.309811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.309896 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.310111 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.310196 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.310413 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.310501 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.310743 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.310829 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.311046 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.311132 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.311348 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.311437 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.311647 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.311776 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.311948 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.312065 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.312268 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.312355 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.312568 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.312661 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.312868 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.312963 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.313175 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.313262 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.313495 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.313614 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.313807 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.313902 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.314111 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.314208 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.314419 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.314518 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.314723 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.314820 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.315025 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.315112 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.315324 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.315410 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.315622 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.315710 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.315921 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.316053 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.316251 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.316350 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.316566 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.316674 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.316912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.316997 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.317212 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.317312 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.317571 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.317657 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.317888 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.317975 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.318204 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.318298 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.318513 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.318601 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.318810 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.318902 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.319116 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.319210 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.319425 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.319511 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.319728 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.319822 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.320070 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.320160 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.320370 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.320455 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.320674 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.320761 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.321008 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.321094 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.321327 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.321421 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.321645 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.321732 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.321945 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.322043 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.322242 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.322329 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.322537 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.322632 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.322837 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.322937 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.323150 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.323236 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.323456 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.323551 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.323756 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.323844 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.324553 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.324651 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.324720 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.324799 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.324875 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.324954 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.325034 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.325112 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.325191 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.325419 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.325507 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.325725 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.325812 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.326031 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.326128 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.326327 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.326413 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.326620 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.326706 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.326912 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.327077 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.327204 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.327292 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.327499 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.327585 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.327799 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.327898 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.328118 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.328210 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.328415 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.328502 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.328710 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.328806 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329004 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329099 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329294 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329380 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329594 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329681 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329895 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.329989 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.330200 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.330287 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.330506 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.330642 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.330810 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.330897 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.331111 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.331197 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.331407 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.331493 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.331718 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.331803 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.332046 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.332136 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.332436 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.332524 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.332740 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.332826 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.333047 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.333141 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.333351 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.333437 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.333658 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.333745 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.333963 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.334063 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.334265 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.334352 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.334565 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.334652 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.334865 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.334960 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.335182 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.335268 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.335499 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.335594 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.335794 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.335882 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.336134 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.336235 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.336448 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.336536 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.336763 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.336851 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.337068 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.337154 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.337373 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.337461 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.337680 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.337768 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.337983 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.338069 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.338287 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.338373 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.338588 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.338676 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.338889 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.338977 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.339191 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.339291 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.339496 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.339590 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.339795 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.339881 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.340123 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.340225 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.340432 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.340519 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.340738 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.340825 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.341056 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.341156 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.341371 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.341457 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.341673 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.341759 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.341982 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.342117 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.342292 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.342386 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.342664 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.342767 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.342920 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.343008 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.343237 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.343332 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.343555 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.343677 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.343863 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.343952 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.344192 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.344281 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.344490 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.344589 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.344725 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 19:17:38.344820 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.345136 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.345448 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.345772 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.346097 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.346442 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.346756 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.347100 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.347428 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.347743 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.348135 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.348443 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:17:38.348685 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 19:17:38.500603 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Registered counter for database nova_api Aug 07 19:17:38.503747 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO dbcounter [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Registered counter for database nova_api Aug 07 19:17:38.520878 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.523316 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_db.sqlalchemy.engines [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.527569 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:38.529935 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writer thread running {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:38.582375 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.context [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73f98dc0-20c8-4d82-9362-d3c5a0691040(cell1) {{(pid=103159) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 19:17:38.585170 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.context [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73f98dc0-20c8-4d82-9362-d3c5a0691040(cell1) {{(pid=103160) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 19:17:38.586260 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:17:38.586731 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:17:38.588330 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:17:38.589049 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:17:38.589185 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:17:38.589483 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:17:38.589632 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:17:38.591164 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:17:38.591454 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:17:38.591894 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:17:38.592362 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:17:38.593495 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Registered counter for database nova_cell0 Aug 07 19:17:38.594369 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:17:38.596434 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO dbcounter [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Registered counter for database nova_cell0 Aug 07 19:17:38.599071 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Registered counter for database nova_cell1 Aug 07 19:17:38.602024 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO dbcounter [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Registered counter for database nova_cell1 Aug 07 19:17:38.607336 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.609118 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.611038 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_db.sqlalchemy.engines [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.611841 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_db.sqlalchemy.engines [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.616903 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:38.618320 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:38.618905 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writer thread running {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:38.620371 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writer thread running {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:38.761185 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Registered counter for database nova_cell0 Aug 07 19:17:38.763345 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO dbcounter [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Registered counter for database nova_cell0 Aug 07 19:17:38.770567 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.774222 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_db.sqlalchemy.engines [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:17:38.776113 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:38.779461 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writer thread running {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:17:39.111031 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:17:39.113533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: WARNING keystonemiddleware.auth_token [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:17:39.118572 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:17:39.120944 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: WARNING keystonemiddleware.auth_token [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:17:39.464732 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:17:39.466742 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: WARNING keystonemiddleware.auth_token [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:17:39.470804 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:17:39.473535 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: WARNING keystonemiddleware.auth_token [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:17:39.476182 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb0c0ef9c0 pid: 103159 (default app) Aug 07 19:17:39.478966 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb0c0ef9c0 pid: 103160 (default app) Aug 07 19:17:39.489552 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:17:39.490764 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-48a61b53-b809-43c1-98b1-88983ad33eb9 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001860 Aug 07 19:17:39.491176 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Sun Aug 7 19:17:39 2022] GET /compute/v2.1/ => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:18:58.440086 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:18:58.441993 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002756 Aug 07 19:18:58.442557 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:18:58.453951 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=3 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:18:58.454913 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell0:SELECT=3 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:18:58.455739 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell1:SELECT=3 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:18:58.456720 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:18:59.328121 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-903df99a-5f34-43cd-9818-79d76547b99d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:18:59.361049 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-903df99a-5f34-43cd-9818-79d76547b99d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912333 Aug 07 19:18:59.361818 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Sun Aug 7 19:18:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:01.565542 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:01.566534 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-eb4dc628-b883-46cc-bb25-daba2c218c82 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 07 19:19:01.566912 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:02.108052 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-351e13c4-bb27-45bb-a6b2-3d2c2edd9068 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:02.129188 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:19:02.129188 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 07 19:19:02.166434 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-351e13c4-bb27-45bb-a6b2-3d2c2edd9068 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.592875 Aug 07 19:19:02.167373 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:19:02.383974 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-55007b64-1a08-4b2b-8fab-c0e4f261445d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:02.388543 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:19:02.388543 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: warnings.warn(msg) Aug 07 19:19:02.408631 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_api:SELECT=3 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:02.409640 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_cell0:SELECT=3 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:02.410470 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_cell1:SELECT=3 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:02.411387 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:02.460346 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-55007b64-1a08-4b2b-8fab-c0e4f261445d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283983 Aug 07 19:19:02.460981 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Sun Aug 7 19:19:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:04.852510 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-351e13c4-bb27-45bb-a6b2-3d2c2edd9068 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:04.852510 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-351e13c4-bb27-45bb-a6b2-3d2c2edd9068 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 07 19:19:04.852510 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:05.529708 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-33885434-685a-47a3-8620-5def381d67d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:05.550170 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:19:05.550170 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: warnings.warn(msg) Aug 07 19:19:05.573220 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-33885434-685a-47a3-8620-5def381d67d3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715934 Aug 07 19:19:05.574124 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:19:05.586597 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-f3e15e06-33b9-4335-beec-0d442841f9d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:05.589570 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:19:05.589570 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 07 19:19:05.628076 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-f3e15e06-33b9-4335-beec-0d442841f9d6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045180 Aug 07 19:19:05.628683 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Sun Aug 7 19:19:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:07.919016 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-33885434-685a-47a3-8620-5def381d67d3 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:07.920099 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-33885434-685a-47a3-8620-5def381d67d3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Aug 07 19:19:07.920500 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:08.343436 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-503b680e-cad1-438f-bea3-b1836d13a942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:08.363889 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-503b680e-cad1-438f-bea3-b1836d13a942 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436941 Aug 07 19:19:08.364488 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:19:08.377174 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-14b6df2c-ffe2-4ee8-b5a7-ee4eea95e2bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:08.402818 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-14b6df2c-ffe2-4ee8-b5a7-ee4eea95e2bf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029515 Aug 07 19:19:08.403437 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Sun Aug 7 19:19:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:10.616239 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-503b680e-cad1-438f-bea3-b1836d13a942 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:10.617333 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-503b680e-cad1-438f-bea3-b1836d13a942 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Aug 07 19:19:10.617741 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:11.159497 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-112f886e-f42a-48de-9b56-775b2cf3121e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:11.187773 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-112f886e-f42a-48de-9b56-775b2cf3121e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.563382 Aug 07 19:19:11.189634 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:19:11.203702 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-ec3fafa3-01d2-476d-8a9b-ee3d38f1f732 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:11.241612 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-ec3fafa3-01d2-476d-8a9b-ee3d38f1f732 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042602 Aug 07 19:19:11.244122 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Sun Aug 7 19:19:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:13.548572 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-112f886e-f42a-48de-9b56-775b2cf3121e admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:13.550307 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-112f886e-f42a-48de-9b56-775b2cf3121e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002220 Aug 07 19:19:13.551006 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:19:14.285052 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-1c5abc6b-4748-4044-b98e-87aae1f820df admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:14.318123 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-1c5abc6b-4748-4044-b98e-87aae1f820df admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.759595 Aug 07 19:19:14.318927 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:19:14.331434 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-746410bb-bc48-424b-addf-91844e73643a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:14.363796 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-746410bb-bc48-424b-addf-91844e73643a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035713 Aug 07 19:19:14.364926 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Sun Aug 7 19:19:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:16.888346 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-1c5abc6b-4748-4044-b98e-87aae1f820df admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:16.889239 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-1c5abc6b-4748-4044-b98e-87aae1f820df admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Aug 07 19:19:16.889639 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:17.455467 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-f45c3f5d-f91b-4c8b-ba33-cd658a38d44c admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:17.481421 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-f45c3f5d-f91b-4c8b-ba33-cd658a38d44c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.584135 Aug 07 19:19:17.481983 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Sun Aug 7 19:19:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:19:19.843739 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-1c5abc6b-4748-4044-b98e-87aae1f820df admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:19.844839 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-1c5abc6b-4748-4044-b98e-87aae1f820df admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Aug 07 19:19:19.845208 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:20.299496 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-a997356f-813d-4ad0-9494-bf0eaf5f9764 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:20.321308 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-a997356f-813d-4ad0-9494-bf0eaf5f9764 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468983 Aug 07 19:19:20.321892 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:19:20.334907 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-cabcbfa3-1f81-4c37-a1d5-4c5323030e63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:20.361499 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-cabcbfa3-1f81-4c37-a1d5-4c5323030e63 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030509 Aug 07 19:19:20.362118 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Sun Aug 7 19:19:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:22.565873 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-a997356f-813d-4ad0-9494-bf0eaf5f9764 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:22.566940 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-a997356f-813d-4ad0-9494-bf0eaf5f9764 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 07 19:19:22.567525 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:23.028800 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-26c0e816-eeea-4edb-bb1e-bfcb55092f48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "ram": 2048, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:23.051655 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-26c0e816-eeea-4edb-bb1e-bfcb55092f48 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.477359 Aug 07 19:19:23.052505 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:19:23.065985 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-88f0928c-c6e4-473c-8289-ee2764cb1a33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:23.095921 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-88f0928c-c6e4-473c-8289-ee2764cb1a33 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034234 Aug 07 19:19:23.096671 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Sun Aug 7 19:19:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:25.419777 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-26c0e816-eeea-4edb-bb1e-bfcb55092f48 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:25.421252 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-26c0e816-eeea-4edb-bb1e-bfcb55092f48 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Aug 07 19:19:25.421874 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:25.970513 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-5f1a4c66-3fd7-4d2b-8970-f8be6e1688b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:25.992346 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-5f1a4c66-3fd7-4d2b-8970-f8be6e1688b2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.561432 Aug 07 19:19:25.993021 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:19:26.027198 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-9af3c2f4-2dc3-4720-8bab-2f43afa61ce0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:26.070809 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-9af3c2f4-2dc3-4720-8bab-2f43afa61ce0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051925 Aug 07 19:19:26.092024 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Sun Aug 7 19:19:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:28.804773 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-5f1a4c66-3fd7-4d2b-8970-f8be6e1688b2 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:28.806153 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-5f1a4c66-3fd7-4d2b-8970-f8be6e1688b2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001888 Aug 07 19:19:28.808470 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:19:29.587244 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-a78e62e4-cd70-48ad-8a54-f52604d6dd55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "swap": 0}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:29.595627 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:29.621591 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-a78e62e4-cd70-48ad-8a54-f52604d6dd55 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.808229 Aug 07 19:19:29.624052 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:19:29.655516 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-4aff4a34-3c6f-4726-878a-431b338aac02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:29.708522 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-4aff4a34-3c6f-4726-878a-431b338aac02 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059454 Aug 07 19:19:29.709562 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Sun Aug 7 19:19:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:32.727834 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-a78e62e4-cd70-48ad-8a54-f52604d6dd55 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:32.729546 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-a78e62e4-cd70-48ad-8a54-f52604d6dd55 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 Aug 07 19:19:32.730222 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:33.429919 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-e3a4b399-03c1-48f7-83a6-dda7e38601e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:33.461117 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-e3a4b399-03c1-48f7-83a6-dda7e38601e9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.724017 Aug 07 19:19:33.468699 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Sun Aug 7 19:19:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:19:33.481114 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-ce6c224e-1145-43c7-b240-7e73b2591a32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:19:33.521016 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-ce6c224e-1145-43c7-b240-7e73b2591a32 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046509 Aug 07 19:19:33.524824 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Sun Aug 7 19:19:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:53.208082 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-e3a4b399-03c1-48f7-83a6-dda7e38601e9 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:53.209396 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-e3a4b399-03c1-48f7-83a6-dda7e38601e9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Aug 07 19:19:53.209929 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:53.221673 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:53.675196 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-dde1b297-9343-4374-81b5-518b0bd2c93d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:53.706586 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-dde1b297-9343-4374-81b5-518b0bd2c93d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.489113 Aug 07 19:19:53.707465 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Sun Aug 7 19:19:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:19:54.946024 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-e3a4b399-03c1-48f7-83a6-dda7e38601e9 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:54.947091 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-e3a4b399-03c1-48f7-83a6-dda7e38601e9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 07 19:19:54.947565 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:55.617489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-a9bdaf62-cfe6-464a-b494-9645a3cba3fd admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:55.624205 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.wsgi [None req-a9bdaf62-cfe6-464a-b494-9645a3cba3fd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-a9bdaf62-cfe6-464a-b494-9645a3cba3fd admin admin] Request method failure captured: Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Accept: application/json Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Accept-Encoding: gzip, deflate Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Connection: keep-alive Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Content-Length: 0 Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Host: 10.222.0.17 Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Openstack-Api-Version: compute 2.90 Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Openstack-System-Scope: None Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: User-Agent: python-novaclient Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Auth-Token: gAAAAABi8BBa_3pfZd6daykZti-IRkHNvbmWEbaUoRvx2oi9Yo6DLo1GVIswwol9LMa-0SDHp5gd3gkx-rc8qhzyEOAQlVmb_ZI3yEM5wVUrxIEpXNODQKxO2vib4bCvXNDwhCBUXirHQnPHq-JwFbdVGe_9Ll4nKxGqYl8twfcTly6pRwn4Apo Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Domain-Id: None Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Domain-Name: None Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Identity-Status: Confirmed Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Is-Admin-Project: True Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Domain-Id: default Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Domain-Name: Default Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Name: admin Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Role: member,admin,reader Aug 07 19:19:55.627717 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Roles: member,admin,reader Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c00a4064cc8477492c9b8b2e5412197", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant: admin Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant-Name: admin Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User: admin Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Domain-Id: default Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Domain-Name: Default Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Id: 39e61fe22f50447d975033301fd5b706 Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Name: admin Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: method: > Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: exception: Flavor 42 could not be found. Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: action_args: {'id': '42'} Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:19:55.630311 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:55.632424 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.634811 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-a9bdaf62-cfe6-464a-b494-9645a3cba3fd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:19:55.637171 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-a9bdaf62-cfe6-464a-b494-9645a3cba3fd admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.534735 Aug 07 19:19:55.637171 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Sun Aug 7 19:19:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 536 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 19:19:55.643264 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-8a7c929e-f3cb-418a-855a-ed108e8e7b6b admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:55.647882 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:55.669577 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-8a7c929e-f3cb-418a-855a-ed108e8e7b6b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029974 Aug 07 19:19:55.670482 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Sun Aug 7 19:19:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:19:55.681171 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-6ddad784-f813-496c-b7fd-f9c95adf71d1 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:55.706372 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-6ddad784-f813-496c-b7fd-f9c95adf71d1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029139 Aug 07 19:19:55.707015 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Sun Aug 7 19:19:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:19:55.717214 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-bc433c22-ec31-48ae-b0de-2e926f68c149 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:55.724183 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.wsgi [None req-bc433c22-ec31-48ae-b0de-2e926f68c149 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-bc433c22-ec31-48ae-b0de-2e926f68c149 admin admin] Request method failure captured: Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Accept: application/json Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Accept-Encoding: gzip, deflate Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Connection: keep-alive Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Content-Length: 0 Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Host: 10.222.0.17 Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Openstack-Api-Version: compute 2.90 Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Openstack-System-Scope: None Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: User-Agent: python-novaclient Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Auth-Token: gAAAAABi8BBa_3pfZd6daykZti-IRkHNvbmWEbaUoRvx2oi9Yo6DLo1GVIswwol9LMa-0SDHp5gd3gkx-rc8qhzyEOAQlVmb_ZI3yEM5wVUrxIEpXNODQKxO2vib4bCvXNDwhCBUXirHQnPHq-JwFbdVGe_9Ll4nKxGqYl8twfcTly6pRwn4Apo Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Domain-Id: None Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Domain-Name: None Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Identity-Status: Confirmed Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Is-Admin-Project: True Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Domain-Id: default Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Domain-Name: Default Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Name: admin Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Role: member,admin,reader Aug 07 19:19:55.727622 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Roles: member,admin,reader Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c00a4064cc8477492c9b8b2e5412197", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant: admin Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant-Name: admin Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User: admin Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Domain-Id: default Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Domain-Name: Default Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Id: 39e61fe22f50447d975033301fd5b706 Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Name: admin Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: method: > Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: exception: Flavor 42 could not be found. Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: action_args: {'id': '42'} Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:19:55.729932 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:55.731332 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:55.733273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-bc433c22-ec31-48ae-b0de-2e926f68c149 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:19:55.735091 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-bc433c22-ec31-48ae-b0de-2e926f68c149 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015764 Aug 07 19:19:55.735091 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Sun Aug 7 19:19:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 07 19:19:56.756327 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-6ddad784-f813-496c-b7fd-f9c95adf71d1 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:56.758112 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-6ddad784-f813-496c-b7fd-f9c95adf71d1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002623 Aug 07 19:19:56.758878 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:57.411521 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-8a6e55e8-f8ea-4271-a3a2-001a69777e58 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:57.417549 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.wsgi [None req-8a6e55e8-f8ea-4271-a3a2-001a69777e58 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-8a6e55e8-f8ea-4271-a3a2-001a69777e58 admin admin] Request method failure captured: Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Accept: application/json Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Accept-Encoding: gzip, deflate Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Connection: keep-alive Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Content-Length: 0 Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Host: 10.222.0.17 Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Openstack-Api-Version: compute 2.90 Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Openstack-System-Scope: None Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: User-Agent: python-novaclient Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Auth-Token: gAAAAABi8BBcX3sli3jj9elPcGYfly8EBQjuaFR6aKxbqQZjmw4QuWG-UeebE4F46-sB4Vn4v8cjpXAn30TyGuEzpR4A6TBediRoTmBrOD0cSjYv6V1Mz8zK233DxWO_RJ_2GjLvcoAYsD0COXnoiT91CtnOsCOcN9Bk9hjp0Jx8CW3iF7snT8k Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Domain-Id: None Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Domain-Name: None Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Identity-Status: Confirmed Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Is-Admin-Project: True Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Domain-Id: default Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Domain-Name: Default Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Name: admin Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Role: member,admin,reader Aug 07 19:19:57.419134 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Roles: member,admin,reader Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c00a4064cc8477492c9b8b2e5412197", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant: admin Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant-Name: admin Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User: admin Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Domain-Id: default Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Domain-Name: Default Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Id: 39e61fe22f50447d975033301fd5b706 Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Name: admin Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: method: > Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: exception: Flavor 84 could not be found. Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: action_args: {'id': '84'} Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:19:57.420672 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:57.421498 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.422533 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-8a6e55e8-f8ea-4271-a3a2-001a69777e58 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:19:57.423549 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-8a6e55e8-f8ea-4271-a3a2-001a69777e58 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.455234 Aug 07 19:19:57.423549 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Sun Aug 7 19:19:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 19:19:57.431971 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-2ec24738-6fbc-4e03-85b6-61d09d259a4d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:57.448812 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-2ec24738-6fbc-4e03-85b6-61d09d259a4d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021326 Aug 07 19:19:57.449384 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Sun Aug 7 19:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:19:57.460261 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-8ba16129-46e4-46ef-8566-63ae9dd99442 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:57.478821 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-8ba16129-46e4-46ef-8566-63ae9dd99442 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022429 Aug 07 19:19:57.479392 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Sun Aug 7 19:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:19:57.494083 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-dc218b82-ef0e-4ba2-b0f3-7a592cada837 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:57.507061 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.wsgi [None req-dc218b82-ef0e-4ba2-b0f3-7a592cada837 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-dc218b82-ef0e-4ba2-b0f3-7a592cada837 admin admin] Request method failure captured: Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Accept: application/json Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Accept-Encoding: gzip, deflate Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Connection: keep-alive Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Content-Length: 0 Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Host: 10.222.0.17 Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Openstack-Api-Version: compute 2.90 Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Openstack-System-Scope: None Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: User-Agent: python-novaclient Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Auth-Token: gAAAAABi8BBcX3sli3jj9elPcGYfly8EBQjuaFR6aKxbqQZjmw4QuWG-UeebE4F46-sB4Vn4v8cjpXAn30TyGuEzpR4A6TBediRoTmBrOD0cSjYv6V1Mz8zK233DxWO_RJ_2GjLvcoAYsD0COXnoiT91CtnOsCOcN9Bk9hjp0Jx8CW3iF7snT8k Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Domain-Id: None Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Domain-Name: None Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Identity-Status: Confirmed Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Is-Admin-Project: True Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Domain-Id: default Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Domain-Name: Default Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Name: admin Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Role: member,admin,reader Aug 07 19:19:57.509972 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Roles: member,admin,reader Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c00a4064cc8477492c9b8b2e5412197", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant: admin Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant-Name: admin Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User: admin Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Domain-Id: default Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Domain-Name: Default Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Id: 39e61fe22f50447d975033301fd5b706 Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Name: admin Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: method: > Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: exception: Flavor 84 could not be found. Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: action_args: {'id': '84'} Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:19:57.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:57.512392 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:57.513656 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-dc218b82-ef0e-4ba2-b0f3-7a592cada837 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:19:57.514870 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-dc218b82-ef0e-4ba2-b0f3-7a592cada837 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.025930 Aug 07 19:19:57.514870 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Sun Aug 7 19:19:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 19:19:58.557167 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-8ba16129-46e4-46ef-8566-63ae9dd99442 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:58.558948 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-8ba16129-46e4-46ef-8566-63ae9dd99442 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002592 Aug 07 19:19:58.559628 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:19:59.247592 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-9dfb12c1-2a45-4c3d-aaa9-7963e1d545fb admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:59.254274 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.wsgi [None req-9dfb12c1-2a45-4c3d-aaa9-7963e1d545fb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-9dfb12c1-2a45-4c3d-aaa9-7963e1d545fb admin admin] Request method failure captured: Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Accept: application/json Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Accept-Encoding: gzip, deflate Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Connection: keep-alive Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Content-Length: 0 Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Host: 10.222.0.17 Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Openstack-Api-Version: compute 2.90 Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Openstack-System-Scope: None Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: User-Agent: python-novaclient Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Auth-Token: gAAAAABi8BBePeI7bAT3KtrcXqCbMdJdhiKKDW24cjdtRV5t_dFrBsp0yV7qMTSbbzWkbj3XB9tyeBmxAIP59ny1PEbuj2wyUV1HhQvD1cNQOT1eJ9nbKmZcMxDWArTcEfHb2aChYJr1CPh0C2QVnljjZbcnzHVhWRC_XKOxlnlujPOYaAfohaw Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Domain-Id: None Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Domain-Name: None Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Identity-Status: Confirmed Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Is-Admin-Project: True Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Domain-Id: default Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Domain-Name: Default Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Project-Name: admin Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Role: member,admin,reader Aug 07 19:19:59.255974 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Roles: member,admin,reader Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c00a4064cc8477492c9b8b2e5412197", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant: admin Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-Tenant-Name: admin Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User: admin Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Domain-Id: default Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Domain-Name: Default Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Id: 39e61fe22f50447d975033301fd5b706 Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: X-User-Name: admin Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: method: > Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: exception: Flavor 451 could not be found. Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: action_args: {'id': '451'} Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:19:59.258391 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:59.259908 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.261993 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-9dfb12c1-2a45-4c3d-aaa9-7963e1d545fb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:19:59.264238 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-9dfb12c1-2a45-4c3d-aaa9-7963e1d545fb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.441455 Aug 07 19:19:59.264238 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Sun Aug 7 19:19:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 19:19:59.269667 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-d42c22fe-5940-4643-82bd-fa3fc60cc7e1 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:59.286232 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-d42c22fe-5940-4643-82bd-fa3fc60cc7e1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021309 Aug 07 19:19:59.286842 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Sun Aug 7 19:19:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:19:59.297896 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:59.314836 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020623 Aug 07 19:19:59.315629 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Sun Aug 7 19:19:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:19:59.329832 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-511f1881-c59c-4125-b0e9-716171692a15 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:19:59.339565 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.wsgi [None req-511f1881-c59c-4125-b0e9-716171692a15 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-511f1881-c59c-4125-b0e9-716171692a15 admin admin] Request method failure captured: Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Accept: application/json Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Accept-Encoding: gzip, deflate Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Connection: keep-alive Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Content-Length: 0 Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Host: 10.222.0.17 Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Openstack-Api-Version: compute 2.90 Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Openstack-System-Scope: None Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: User-Agent: python-novaclient Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Auth-Token: gAAAAABi8BBePeI7bAT3KtrcXqCbMdJdhiKKDW24cjdtRV5t_dFrBsp0yV7qMTSbbzWkbj3XB9tyeBmxAIP59ny1PEbuj2wyUV1HhQvD1cNQOT1eJ9nbKmZcMxDWArTcEfHb2aChYJr1CPh0C2QVnljjZbcnzHVhWRC_XKOxlnlujPOYaAfohaw Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Domain-Id: None Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Domain-Name: None Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Identity-Status: Confirmed Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Is-Admin-Project: True Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Domain-Id: default Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Domain-Name: Default Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Project-Name: admin Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Role: member,admin,reader Aug 07 19:19:59.342717 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Roles: member,admin,reader Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c00a4064cc8477492c9b8b2e5412197", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c00a4064cc8477492c9b8b2e5412197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant: admin Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant-Id: 6c00a4064cc8477492c9b8b2e5412197 Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-Tenant-Name: admin Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User: admin Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Domain-Id: default Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Domain-Name: Default Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Id: 39e61fe22f50447d975033301fd5b706 Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: X-User-Name: admin Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: method: > Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: exception: Flavor 451 could not be found. Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: action_args: {'id': '451'} Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:19:59.344656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:59.345913 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: ERROR nova.api.openstack.wsgi Aug 07 19:19:59.348411 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-511f1881-c59c-4125-b0e9-716171692a15 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:19:59.350488 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-511f1881-c59c-4125-b0e9-716171692a15 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.022199 Aug 07 19:19:59.350488 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Sun Aug 7 19:19:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 19:20:00.362038 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:20:00.363114 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Aug 07 19:20:00.363561 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:20:00.982287 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-92b94781-5bb5-43f2-9c57-2aaff89f3b1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:20:01.003603 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-92b94781-5bb5-43f2-9c57-2aaff89f3b1d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.504237 Aug 07 19:20:01.004191 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Sun Aug 7 19:20:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:20:02.058303 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:20:02.059758 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Aug 07 19:20:02.060331 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:20:02.713687 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-4a56669a-3e47-4258-bd66-79f789c2317c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:20:02.734612 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-4a56669a-3e47-4258-bd66-79f789c2317c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.534883 Aug 07 19:20:02.735338 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Sun Aug 7 19:20:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:20:03.774716 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:20:03.775723 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 07 19:20:03.776167 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:20:04.407355 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-93997140-b573-48f1-bf12-79dfc734952c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:20:04.430485 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-93997140-b573-48f1-bf12-79dfc734952c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.514435 Aug 07 19:20:04.431679 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Sun Aug 7 19:20:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:20:05.609255 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:20:05.611025 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002489 Aug 07 19:20:05.611708 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:20:06.267146 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-f626b1dd-4d5b-4c3a-8a13-38486d2fde88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:20:06.288656 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-f626b1dd-4d5b-4c3a-8a13-38486d2fde88 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.509466 Aug 07 19:20:06.289235 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Sun Aug 7 19:20:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:20:07.358488 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:20:07.359821 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001852 Aug 07 19:20:07.360538 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:20:07.994247 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-76af3992-6902-4cdf-a62b-45c64772551e admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:20:08.033428 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-76af3992-6902-4cdf-a62b-45c64772551e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.532257 Aug 07 19:20:08.034444 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Sun Aug 7 19:20:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:21:03.180949 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:21:03.181834 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-640d71dd-a084-4bd6-bf12-1fdcd2859095 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 07 19:21:03.182272 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Sun Aug 7 19:21:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:21:03.198629 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:03.680826 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-f6a1c14a-13c5-4519-b405-a2c63eb5ef12 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:21:03.702359 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-f6a1c14a-13c5-4519-b405-a2c63eb5ef12 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.512063 Aug 07 19:21:03.702938 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Sun Aug 7 19:21:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:21:03.724632 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=14 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:03.729198 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-c0ced67c-f6f7-42b6-8598-aa6814d16fd4 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:21:03.739665 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-c0ced67c-f6f7-42b6-8598-aa6814d16fd4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016419 Aug 07 19:21:03.740275 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Sun Aug 7 19:21:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:21:03.753352 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-489ab72d-f13d-4032-a057-dfb9c9507b42 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:21:03.762301 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-489ab72d-f13d-4032-a057-dfb9c9507b42 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012889 Aug 07 19:21:03.762779 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Sun Aug 7 19:21:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:21:03.784810 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:21:03.797395 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020529 Aug 07 19:21:03.798058 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Sun Aug 7 19:21:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:21:03.812144 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-a3e54dd5-8d88-4a7e-bfa0-ec2f52a6fe87 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:21:03.820758 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-a3e54dd5-8d88-4a7e-bfa0-ec2f52a6fe87 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012616 Aug 07 19:21:03.821333 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Sun Aug 7 19:21:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:24:04.107220 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:04.108445 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Aug 07 19:24:04.109000 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:24:04.269496 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_api:SELECT=6 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:24:04.466555 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:04.469273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:24:04.469273 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: warnings.warn(msg) Aug 07 19:24:04.470544 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:04.471068 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:04.471578 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:04.472377 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:04.472815 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:04.473287 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:04.511137 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-10efea2b-a372-4b31-b5bb-1008401d7a83 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.247015 Aug 07 19:24:04.511767 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Sun Aug 7 19:24:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:24:05.475841 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:05.476922 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Aug 07 19:24:05.477449 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:24:05.721233 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:05.724772 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:24:05.724772 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: warnings.warn(msg) Aug 07 19:24:05.726037 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:05.726586 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:05.727852 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:05.728699 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:05.729326 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:05.729793 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:05.751757 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-a6aa7368-8caf-4ccc-8543-f447c32bd1ce admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.116719 Aug 07 19:24:05.752467 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Sun Aug 7 19:24:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:24:17.038853 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:17.039878 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 07 19:24:17.040335 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:24:17.183190 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_cell0:SELECT=4 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:24:17.184132 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_cell1:SELECT=4 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:24:17.184755 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG dbcounter [-] [103160] Writing DB stats nova_api:SELECT=8 {{(pid=103160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:24:17.241171 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:17.243676 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:24:17.243676 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: warnings.warn(msg) Aug 07 19:24:17.244893 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:17.245370 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:17.245796 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:17.246508 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:17.246955 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:17.247370 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:17.272582 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-587a00dc-0186-481d-a531-b86289248e4d admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093800 Aug 07 19:24:17.273161 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Sun Aug 7 19:24:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:24:18.109648 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:18.110709 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-4906aab3-9707-423c-9e56-4929af04536d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 07 19:24:18.111107 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Sun Aug 7 19:24:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:24:18.306214 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG nova.api.openstack.wsgi [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] Calling method '>' {{(pid=103160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:24:18.308673 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:24:18.308673 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: warnings.warn(msg) Aug 07 19:24:18.309793 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:18.310265 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:18.310689 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:18.311395 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:24:18.311834 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:24:18.312272 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: DEBUG oslo_concurrency.lockutils [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:24:18.334559 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: INFO nova.api.openstack.requestlog [None req-19ea4758-a7a8-4eb8-ae18-386c3c6fa5b9 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084092 Aug 07 19:24:18.335147 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: [pid: 103160|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Sun Aug 7 19:24:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:25:11.696462 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: Sun Aug 7 19:25:11 2022 - graceful shutdown triggered... Aug 07 19:25:11.695828 dv-cinder-850320-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 07 19:25:11.697445 dv-cinder-850320-4-iscsi devstack@n-api.service[103159]: Gracefully killing worker 1 (pid: 103159)... Aug 07 19:25:11.697812 dv-cinder-850320-4-iscsi devstack@n-api.service[103160]: Gracefully killing worker 2 (pid: 103160)... Aug 07 19:25:12.696832 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: worker 1 buried after 1 seconds Aug 07 19:25:12.696832 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: worker 2 buried after 1 seconds Aug 07 19:25:12.696832 dv-cinder-850320-4-iscsi devstack@n-api.service[103158]: goodbye to uWSGI. Aug 07 19:25:12.698792 dv-cinder-850320-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 07 19:25:12.699649 dv-cinder-850320-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 07 19:25:12.703903 dv-cinder-850320-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 19:25:12.714935 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 19:25:12.718454 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 19:25:12 2022] *** Aug 07 19:25:12.718668 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 19:25:12.718801 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 19:25:12.718911 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: nodename: dv-cinder-850320-4-iscsi Aug 07 19:25:12.719018 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: machine: x86_64 Aug 07 19:25:12.719138 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: clock source: unix Aug 07 19:25:12.719250 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: pcre jit disabled Aug 07 19:25:12.719363 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: detected number of CPU cores: 4 Aug 07 19:25:12.719469 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: current working directory: / Aug 07 19:25:12.719578 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: detected binary path: /usr/bin/uwsgi-core Aug 07 19:25:12.719691 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: your processes number limit is 47680 Aug 07 19:25:12.719816 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: your memory page size is 4096 bytes Aug 07 19:25:12.719816 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: detected max file descriptor number: 2048 Aug 07 19:25:12.719816 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: lock engine: pthread robust mutexes Aug 07 19:25:12.720183 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: thunder lock: enabled Aug 07 19:25:12.720183 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 19:25:12.720342 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 19:25:12.760668 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: Python main interpreter initialized at 0x55f7483d09c0 Aug 07 19:25:12.760668 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: python threads support enabled Aug 07 19:25:12.760668 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: your server socket listen backlog is limited to 100 connections Aug 07 19:25:12.760668 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: your mercy for graceful operations on workers is 90 seconds Aug 07 19:25:12.761294 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 19:25:12.761294 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: *** Operational MODE: preforking *** Aug 07 19:25:12.761534 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: *** uWSGI is running in multiple interpreter mode *** Aug 07 19:25:12.761534 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: spawned uWSGI master process (pid: 117809) Aug 07 19:25:12.761619 dv-cinder-850320-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 19:25:12.764241 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: spawned uWSGI worker 1 (pid: 117832, cores: 1) Aug 07 19:25:12.764785 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: spawned uWSGI worker 2 (pid: 117833, cores: 1) Aug 07 19:25:12.765097 dv-cinder-850320-4-iscsi devstack@n-api.service[117809]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 19:25:13.440728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 19:25:13.445032 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 19:25:14.585823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:25:14.585823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: from cryptography.utils import int_from_bytes Aug 07 19:25:14.585823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:25:14.585823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: from cryptography.utils import int_from_bytes Aug 07 19:25:14.590992 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:25:14.590992 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes Aug 07 19:25:14.591582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:25:14.591582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes Aug 07 19:25:16.951084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 19:25:16.951745 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 19:25:16.952053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 19:25:16.952274 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 19:25:16.952532 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 19:25:16.952906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.953258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.953590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.953906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.954234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.954544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.954870 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.955171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.955547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.955809 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.956225 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.956456 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-4-iscsi {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.956789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.957096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.957481 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.957857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.958239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.958571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.958690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.959569 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.961128 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.961487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.961814 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.962172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.962491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.962804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.963118 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.963433 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.963768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.964109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.964547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-4-iscsi {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.964833 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.965154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.965478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.965931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.966214 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.966639 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.966980 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.967306 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.967617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.968055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.968461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.968788 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.969109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.969485 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.969852 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.970225 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.970571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.970920 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.971324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.971583 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.971888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.972237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.972561 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.972884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.973160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.973419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.973741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.974062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.974371 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.974683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.974992 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.975296 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.976086 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.976086 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.976273 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.976553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.977181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.977449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.977775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.978171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.978565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.978707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 19:25:16.979201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 19:25:16.979338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.979338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.979619 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 19:25:16.979754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.979901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 19:25:16.980096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.980264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 19:25:16.980407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.980564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.980708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.980864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.981003 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.981146 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.981289 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.981456 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.981621 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.981808 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.981951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.982085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.982229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.982363 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.982496 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.982644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.982785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.982920 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.983061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.983202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.983350 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.983520 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.983657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.983801 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.983931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-4-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.984096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.984247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.984776 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.984919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.985061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.985196 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.985836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.985996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.986145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.986288 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.986432 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.986592 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.986954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.987109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.987254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.987388 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.987541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.987676 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.987828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.987972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.988137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.988280 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.988422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.988564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.988713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.988858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.988999 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.989143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.989286 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.989437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.989585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.989719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.989865 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.990010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.990152 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.990294 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.990437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.990570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-4-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.990713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.990854 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.991005 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.991148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.991281 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.991500 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.991647 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.991835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.991976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.992147 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.992290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.992432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.992580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.992724 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.992858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.993002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.993146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.993289 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.993447 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.993579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.993732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.993732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.994012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.994012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.994292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.994292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.995070 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.995222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.995376 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.995757 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.996098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.996247 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.996404 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.998996 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.999168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.999312 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.999449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.999584 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.999719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:16.999719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.000943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.001218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.001369 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.001514 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.001657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.001792 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.001924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.002058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.002189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.002410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.002574 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.002574 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.002837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.002971 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.003103 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.003245 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.003387 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.003532 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.003664 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.003811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.003965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.004134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.004277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.004419 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.004563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.004987 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.011496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.018535 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.018704 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.018862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.019014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.019168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.019325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.019469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.019627 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.019773 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.019908 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.020078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.020223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.020372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.020506 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.020647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.020789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.020933 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.021075 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.021209 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.021481 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.021749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.021888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.022034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.022177 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.022312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.022464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.022549 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.022634 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.022705 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.022780 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.022850 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.022924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.022994 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.023076 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.023147 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.023221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.023291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.023291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.023415 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.023495 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.023567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.023636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.023711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.023818 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.023894 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.023972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.024094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.024164 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.024243 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.024325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.024325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.024472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.024551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.024622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.024696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.024766 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.024845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.024915 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.025008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.025085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.025158 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.026015 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.026102 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.026175 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.026252 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.026323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.026399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.026470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.026547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.026618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.026687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.026767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.026848 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.026924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.027013 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.027092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.027169 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.027245 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.027352 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.027439 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.027517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.027594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.027671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.027749 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.027826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.027896 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.028589 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.028744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.028905 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.029057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.029207 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.029382 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.029537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.029687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.029828 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.030053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.030214 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.030354 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.030492 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.030639 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.030790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.030944 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.031084 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.031229 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.031375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.031375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.031750 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.031909 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.032162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.032328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.032477 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.032623 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.032770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.032924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.033073 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.033212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.033350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.033489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.033489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.033838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.033982 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.034120 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.034278 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.034425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.034425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.034704 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.034704 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.034974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.035115 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.035263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.035674 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.035822 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.035961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:25:17.036143 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.036411 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.036578 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.036732 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.036872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.037011 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.037160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.037928 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.038084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.038523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.038684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.038893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.039101 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.039503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.039658 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.039806 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.039954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.040131 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.040282 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.040423 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.040569 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.040716 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.040865 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.041012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.041152 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.041310 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.041457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.041596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.041768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.042025 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.042189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.042462 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.042608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.042747 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.042899 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.043049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.043204 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.043344 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.043494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.043784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.043964 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.044210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.044358 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.044507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.044663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.044811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.044966 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.045113 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.045260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.045486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.045872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.046047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.046197 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.046338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.046590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.046737 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.046878 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.047033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.047181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.047328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.047475 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.047650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.047791 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.047961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.048125 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.048265 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.049058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.049236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.049421 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.049600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.049745 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.049892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.050041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.050180 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.050180 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.050458 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.050622 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.050770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.050918 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.051063 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.051224 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.051606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.051756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.051905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.052303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.052488 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.052643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.052943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053088 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053410 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.053970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054411 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054583 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054760 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.054922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055003 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055085 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055085 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055243 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055332 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055415 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055553 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055689 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.055957 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056065 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056159 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056250 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056349 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056440 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056628 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056789 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056881 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.056972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057146 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057227 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057409 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057499 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.057933 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058173 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058414 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058583 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.058761 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059155 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059348 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.059897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060017 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060344 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060415 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060497 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060863 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.060947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061035 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061117 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061207 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061886 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.061970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062340 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062433 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062697 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.062944 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063118 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063294 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063378 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063541 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063805 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.063895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064087 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064169 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064266 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064360 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064691 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.064974 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065231 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065314 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065408 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065504 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065637 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065735 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065820 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065902 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.065993 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066497 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066662 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066824 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.066919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067365 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067462 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.067900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068017 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068448 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068706 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068789 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.068990 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069377 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069554 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069644 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.069971 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070055 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070150 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070235 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070404 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070667 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.070923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071182 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071258 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071534 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071715 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071889 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.071973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072134 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072388 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072832 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.072962 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073048 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073138 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073415 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073677 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073766 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073848 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.073936 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074212 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074304 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074304 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074642 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074782 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.074940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075454 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075539 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075822 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.075983 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076365 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.076951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077020 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077246 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077246 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077246 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077246 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077532 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077747 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077814 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077889 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.077966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.078074 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.078176 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.078247 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.078468 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.078556 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.078798 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.078877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.079116 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.079478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.079478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.079658 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.079865 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.080204 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.080547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.080861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.081016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.081190 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.081375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.081505 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.081702 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.081891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.082028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.082187 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.082346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.082446 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.082685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.082783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.083006 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.083101 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.083316 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.083601 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.083701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.083923 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.084046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.084288 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.084375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.084595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.084702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.084908 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.085025 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.085231 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.085348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.085552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.085694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.085858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.086084 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.086240 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.086457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.086559 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.086762 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.086864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.087067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.087158 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.087378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.087477 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.087680 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.087778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.088027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.088144 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.088305 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.088407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.088607 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.088706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.088909 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.089000 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.089231 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.089365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.089548 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.089733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.089853 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.089932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.090138 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.090232 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.090434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.090533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.090751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.090878 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.091058 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.091159 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.091370 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.091469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.091675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.091772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.092014 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.092110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.092333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.092425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.092640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.092745 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.092944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.093042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.093249 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.093348 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.093550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.093648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.093864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.093955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.094172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.094262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.094482 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.094587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.094785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.094877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.095108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.095204 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.095414 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.095514 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.095725 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.095862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.096075 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.096262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.096442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.096541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.096750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.096849 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.097065 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.097156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.097366 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.097474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.097672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.097770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.097978 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.098096 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.098283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.098374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.098587 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.098678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.098895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.098985 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.099199 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.099290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.099506 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.099623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.099813 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.099935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.100138 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.100228 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.100458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.100626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.100767 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.100929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.101062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.101164 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.101340 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.101444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.101641 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.101744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.101941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.102031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.102251 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.102342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.102558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.102657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.102864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.102955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.103166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.103263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.103470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.103568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.103769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.103859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.104104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.104236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.104417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.104553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.104723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.104865 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.105045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.105169 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.105357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.105480 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.105657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.105789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.105959 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.106105 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.106267 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.106419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.106570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.106723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.106870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.107137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.107237 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.107447 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.107545 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.107754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.107844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.108084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.108185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.108390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.108483 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.108691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.108790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.108996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.109092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.109302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.109389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.109601 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.109690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.109911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.110061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.110205 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.110306 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.110505 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.110596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.110808 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.110908 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.111112 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.111211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.111431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.111537 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.111775 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.111944 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.112130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.112258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.112395 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.112565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.112697 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.112873 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.113041 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.113181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.113349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.113500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.113702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.113819 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.114007 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.114138 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.114320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.114439 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.114644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.114743 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.114957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.115049 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.115266 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.115359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.115580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.115672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.115884 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.115977 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.116227 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.116327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.116543 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.116673 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.116849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.116941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.117153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.117253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.117461 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.117555 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.117778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.117869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.118087 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.118184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.118395 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.118487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.118719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.118831 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.119038 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.119130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.119360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.119451 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.119665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.119764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120331 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.120979 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.121196 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.121288 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.121494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.121592 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.121802 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.121899 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.122106 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.122202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.122412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.122500 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.122712 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.122809 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.123043 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.123142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.123362 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.123454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.123662 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.123762 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.123965 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.124093 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.124301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.124391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.124612 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.124701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.124916 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.125007 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.125217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.125315 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.125519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.125617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.125826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.125918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.126457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.126548 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.126641 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.126726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.126813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.126898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.127029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.127128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.127357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.127538 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.127707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.127808 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.128056 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.128153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.128386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.128487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.128734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.128828 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.129066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.129167 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.129393 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.129499 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.129711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.129803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.130026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.130185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.130350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.130479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.130659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.130770 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.130954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.131046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.131263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.131366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.131565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.131666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.131867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.131955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.132197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.132299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.132506 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.132606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.132806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.132895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.133106 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.133206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.133408 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.133511 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.133728 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.133874 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.134028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.134121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.134344 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.134444 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.134650 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.134817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.134949 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.135131 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.135250 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.135443 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.135534 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.135764 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.135863 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.136110 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.136206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.136437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.136528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.136742 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.136837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.137054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.137140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.137370 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.137468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.137694 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.137785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.138008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.138099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.138315 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.138414 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.138624 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.138720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.138925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.139015 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.139237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.139342 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.139547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.139646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.139858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.139956 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.140209 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.140323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.140524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.140632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.140929 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.141095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.141241 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.141419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.141562 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.141732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.141887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.142043 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.142193 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.142354 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.142496 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.142665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.142807 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.143004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.143171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.143381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.143482 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.143715 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.143840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.144024 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.144135 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.144338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.144436 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.144662 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.144755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.144981 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.145074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.145283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.145395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.145587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.145682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.145909 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.146000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.146212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.146303 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.146521 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.146611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.146829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.146953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.147152 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.147241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.147480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.147580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.147783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.147872 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.148130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.148229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.148441 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.148544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.148763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.148860 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.149045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.149146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.149344 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.149495 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.149636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.149736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.149948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.150041 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.150259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.150391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.150570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.150662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.150882 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.150997 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.151191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.151291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.151512 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.151604 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.151836 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.151934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.152179 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.152268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.152491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.152598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.152800 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.152893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.153101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.153199 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.153405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.153622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.153723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.153935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.154147 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.154274 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.154349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.154579 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.154685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.154884 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.154979 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.155187 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.155284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.155489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.155599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.155790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.155886 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.156126 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.156224 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.156431 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.156538 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.156738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.156842 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.157049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.157172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.157342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.157454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.157643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.157739 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.157944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.158040 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.158241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.158349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.158577 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.158678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.158893 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.158988 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.159220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.159428 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.159525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.159784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.159880 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.160134 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.160229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.160456 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.160574 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.160798 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.160914 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.161078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.161287 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.161412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.161490 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.161693 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.161788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.161995 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.162101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.162299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.162390 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.162613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.162708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.162919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.163026 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.163221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.163481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.163577 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.163810 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.163906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.164142 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.164249 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.164446 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.164543 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.164754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.164859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.165054 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.165158 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.165364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.165458 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.165663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.165765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.165964 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.166071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.166265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.166360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.166572 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.166678 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.166868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.166968 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.167165 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.167262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.167465 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.167560 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.167763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.167858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.168103 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.168213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.168407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.168504 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.168723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.168833 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.169013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.169110 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.169342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.169450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.169623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.169727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.169932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.170033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.170221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.170325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.170544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.170700 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.170846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.170984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.171219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.171498 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.171596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.171819 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.171923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.172153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.172260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.172467 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.172566 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.172778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.172889 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.173083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.173186 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.174322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.174639 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.174727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.174823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.174908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.174991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.175082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.175172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.175256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.175351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.175442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.175661 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.175764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.176045 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.176231 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.176339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.176555 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.176659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.176895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.176990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.177220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.177342 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.177535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.177633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.177846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.177942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.178156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.178252 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.178464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.178566 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.178774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.178893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.179108 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.179256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.179429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.179565 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.179696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.179806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.180025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.180178 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.180357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.180505 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.180625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.180731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.181045 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.181162 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.181263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.181362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.181531 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.181710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.181844 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.182101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.182237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.182451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.182609 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.182745 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.182845 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.183091 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.183240 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.183409 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.183564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.183685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.183784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.184022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.184158 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.184366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.184528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.184631 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.184723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.184960 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.185096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.185276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.185428 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.185560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.185670 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.185884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.186041 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.186154 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.186295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.186464 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.186596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.186774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.186922 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.187082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.187241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.187397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.187546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.187701 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.187864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.188041 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.188209 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.188354 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.188501 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.188641 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.188820 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.188933 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.189130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.189243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.189460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.189585 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.189832 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.189934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.190165 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.190268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.190474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.190593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.190772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.190860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.191100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.191207 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.191369 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.191462 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.191662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.191763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.191973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.192086 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.192311 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.192417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.192613 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.192705 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.192914 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.193005 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.193221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.193334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.193522 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.193623 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.193823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.193921 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.194123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.194223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.194424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.194552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.194728 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.194823 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.195027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.195127 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.195327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.195418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.195626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.195717 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.195925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.196097 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.196255 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.196556 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.196646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.196898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.196999 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.197208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.197301 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.197510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.197601 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.197808 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.197904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.198115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.198206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.198405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.198498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.198730 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.198838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.199051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.199151 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.199364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.199483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.199680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.199787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.199978 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.200089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.200313 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.200405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.200620 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.200721 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.200924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.201022 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.201424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.201527 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.201620 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.201833 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.201933 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.202141 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.202238 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.202449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.202551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.202754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.202845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.203058 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.203158 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.203363 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.203460 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.203671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.203771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.203982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.204107 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.204318 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.204410 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.204639 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.204775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.204935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.205034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.205250 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.205358 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.205618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.205726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.205929 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.206023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.206238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.206337 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.206541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.206632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.206854 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.206953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.207164 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.207304 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.207468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.207561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.207775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.207919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.208107 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.208214 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.208420 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.208590 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.208741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.208889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.209017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.209132 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.209324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.209435 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.209638 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.209741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.209951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.210045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.210276 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.210382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.210596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.210705 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.210950 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.211051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.211224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.211334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.211547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.211649 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.211888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.211981 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.212224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.212318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.212529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.212621 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.212834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.212934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.213138 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.213226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.213451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.213550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.213759 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.213859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.214001 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 19:25:17.214094 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.214353 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.214655 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.214968 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.215267 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.215571 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.215873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.216203 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.216618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.216923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.217227 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.217536 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.217840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.218146 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.218447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.218756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.219061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.219365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.219666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.219972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.220296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.220640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.220973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.221336 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.221663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.221974 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.222291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.222606 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.222922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.223242 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.223562 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.223869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.224237 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.224550 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.224864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.225173 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.225486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.225794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.226104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.226439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.226764 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.227074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.227409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.227725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.228234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.228423 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.228698 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.229284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.229284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.229640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.229951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.230262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.230569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.230891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.231192 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.231502 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.231823 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.232185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.232525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.232851 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.233172 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.233508 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.233834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.234191 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.234512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.234851 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.235187 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.235497 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.235809 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.236227 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:25:17.236473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 19:25:17.372089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Registered counter for database nova_api Aug 07 19:25:17.392785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.393817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Registered counter for database nova_api Aug 07 19:25:17.400498 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.414795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.422010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.460025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.context [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73f98dc0-20c8-4d82-9362-d3c5a0691040(cell1) {{(pid=117833) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 19:25:17.462598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:25:17.463071 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:25:17.464683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:25:17.465427 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:25:17.465870 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:25:17.467887 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:25:17.470028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Registered counter for database nova_cell0 Aug 07 19:25:17.474381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Registered counter for database nova_cell1 Aug 07 19:25:17.481790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.483714 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.484080 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.context [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73f98dc0-20c8-4d82-9362-d3c5a0691040(cell1) {{(pid=117832) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 19:25:17.488627 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:25:17.489112 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:25:17.489283 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.490741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:25:17.491518 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:25:17.491976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:25:17.494146 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:25:17.495335 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.496298 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Registered counter for database nova_cell0 Aug 07 19:25:17.500730 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Registered counter for database nova_cell1 Aug 07 19:25:17.508119 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.510838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.514868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.639472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Registered counter for database nova_cell0 Aug 07 19:25:17.647097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.652250 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.658286 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.668279 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Registered counter for database nova_cell0 Aug 07 19:25:17.676293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:25:17.681797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:25:17.973830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:25:17.981906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:25:18.131954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:25:18.139386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:25:18.334360 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:25:18.340972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-3b4727ab-e7dc-46d6-ba05-a8dacfdecc84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:25:18.347910 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7483d09c0 pid: 117833 (default app) Aug 07 19:25:18.484883 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 19:25:18.491036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-53e37c7a-3757-4f33-a874-4e3c269720bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 19:25:18.497340 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7483d09c0 pid: 117832 (default app) Aug 07 19:25:56.925312 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:56.930121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:56.933333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:56.936916 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:58.868511 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ebb8a5f9-d50a-44eb-ab9d-9c4d781ef99f tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Action: 'create', calling method: .version_select at 0x7fd47cd92e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2145307287"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:01.447150 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-04225ceb-4271-44bc-bf1e-c8b3c39cee7c tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47cdbc940>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:01.509611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:01.513012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:01.514957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:01.516625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:01.658588 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ebb8a5f9-d50a-44eb-ab9d-9c4d781ef99f tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.790774 Aug 07 19:26:01.671154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Sun Aug 7 19:25:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4806 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 19:26:01.677647 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-00536c0d-b8ca-4d3b-8fcd-7db7c91be852 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb60ca0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:01.838575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-00536c0d-b8ca-4d3b-8fcd-7db7c91be852 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49" status: 200 len: 345 microversion: 2.1 time: 0.165959 Aug 07 19:26:01.852319 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 2/2] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:01 2022] GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:02.233789 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-04225ceb-4271-44bc-bf1e-c8b3c39cee7c tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e7cbcd0a-b6ea-46a1-b665-e6a055f30b60" status: 200 len: 351 microversion: 2.1 time: 1.290160 Aug 07 19:26:02.234516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 1/3] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:00 2022] GET /compute/v2.1/os-volumes/e7cbcd0a-b6ea-46a1-b665-e6a055f30b60 => generated 351 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:26:02.856617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1092614d-7c81-47b2-8e23-37a3d587a3bc tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb733a0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:03.019862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1092614d-7c81-47b2-8e23-37a3d587a3bc tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49" status: 200 len: 346 microversion: 2.1 time: 0.168387 Aug 07 19:26:03.021000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:02 2022] GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 => generated 346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:03.036271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-97e41bac-3543-486e-92b5-97a781b35afa tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Action: 'create', calling method: .version_select at 0x7fd47cc0ec10>, body: {"snapshot": {"volume_id": "dc451db1-ac00-417a-a75f-d68fd1d46d49", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1067346093"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:03.564795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-97e41bac-3543-486e-92b5-97a781b35afa tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.533409 Aug 07 19:26:03.584640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-630da922-1c42-4c0a-8036-dfdb6f395198 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb73a60>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:03.586208 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 2/5] 10.222.0.17 () {60 vars in 1162 bytes} [Sun Aug 7 19:26:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:03.685165 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-630da922-1c42-4c0a-8036-dfdb6f395198 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 287 microversion: 2.1 time: 0.111523 Aug 07 19:26:03.687807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:03 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:03.701203 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e5f7faae-2e35-423e-9c2a-6b09c1671097 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb589d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:03.795520 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e5f7faae-2e35-423e-9c2a-6b09c1671097 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.101438 Aug 07 19:26:03.796401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 3/7] 10.222.0.17 () {58 vars in 1140 bytes} [Sun Aug 7 19:26:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:26:03.816687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-34c9ffca-5886-4a0f-ad06-9c3959596ab9 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb60ca0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:03.910607 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-34c9ffca-5886-4a0f-ad06-9c3959596ab9 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 287 microversion: 2.1 time: 0.099324 Aug 07 19:26:03.912264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:03 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:04.295803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-12131ded-8d6a-49bf-8e84-bdd71d32f9c0 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47cc86dc0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:04.555572 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-12131ded-8d6a-49bf-8e84-bdd71d32f9c0 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/11f508a7-78f4-41d1-b5a4-243ea4fbc273" status: 200 len: 351 microversion: 2.1 time: 0.267193 Aug 07 19:26:04.569859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 4/9] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:04 2022] GET /compute/v2.1/os-volumes/11f508a7-78f4-41d1-b5a4-243ea4fbc273 => generated 351 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:04.932365 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-866906db-945d-415d-9d34-4d53209b799c tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb739d0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:05.078685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-866906db-945d-415d-9d34-4d53209b799c tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 287 microversion: 2.1 time: 0.153244 Aug 07 19:26:05.095168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 6/10] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:04 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:06.115230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-988ba3f7-4083-41d0-9e5f-9bf317a1bb52 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb71040>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:06.226401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-988ba3f7-4083-41d0-9e5f-9bf317a1bb52 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 287 microversion: 2.1 time: 0.134159 Aug 07 19:26:06.230104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 5/11] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:06 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:26:07.273440 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afd59453-fc16-4803-8113-8093c6aec28d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb73310>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:07.408160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-afd59453-fc16-4803-8113-8093c6aec28d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 288 microversion: 2.1 time: 0.168419 Aug 07 19:26:07.409696 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 7/12] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:07 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 288 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:07.421139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-066b9b43-2449-480e-bc22-4f92a31c8f06 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb71790>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:07.569443 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-066b9b43-2449-480e-bc22-4f92a31c8f06 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 202 len: 0 microversion: 2.1 time: 0.152666 Aug 07 19:26:07.570665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1254 bytes} [Sun Aug 7 19:26:07 2022] DELETE /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:26:07.580543 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-efed3ced-64a4-4b40-9bab-4f67311532b1 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb731f0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:07.654665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-efed3ced-64a4-4b40-9bab-4f67311532b1 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 287 microversion: 2.1 time: 0.078163 Aug 07 19:26:07.660391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 8/14] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:07 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:08.152698 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45db4d7f-8951-4ae1-8ebd-9f340145a47c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: .version_select at 0x7fd47d4e61f0>, body: {"keypair": {"name": "tempest-keypair-1221461059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNqHvwl/p0Sruj+sBV/Ij4kHrCKw/6fEV5qfDeDklz2ezeego74oCecJ7eNHAgB7ar/Zz3THJzViohX1Q3Wohh2LgWYA+gyJ2U0J5BRE1XPfc0yKctRaWmbI4Qudh6GjA=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:08.261715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-45db4d7f-8951-4ae1-8ebd-9f340145a47c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:26:08.291102 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-45db4d7f-8951-4ae1-8ebd-9f340145a47c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:26:08.421873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45db4d7f-8951-4ae1-8ebd-9f340145a47c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.573794 Aug 07 19:26:08.422537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 7/15] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:26:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:08.667449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0843a169-fdcb-4437-94dc-85ffbbee790a tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb73820>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:08.729970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0843a169-fdcb-4437-94dc-85ffbbee790a tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 287 microversion: 2.1 time: 0.066623 Aug 07 19:26:08.735257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 9/16] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:08 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:09.743421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-38a7032d-90e1-47a9-999c-828c953cf2bd tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb499d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:09.827458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-38a7032d-90e1-47a9-999c-828c953cf2bd tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 200 len: 287 microversion: 2.1 time: 0.088175 Aug 07 19:26:09.828381 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 8/17] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:09 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:10.840885 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a6560580-6e46-4a10-8b70-4271ed8fb0fe tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cb60a60>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:10.917891 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-a6560580-6e46-4a10-8b70-4271ed8fb0fe tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] HTTP exception thrown: Snapshot 86c67057-0503-4708-9b6c-6e3f8ff32d3f could not be found. Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a6560580-6e46-4a10-8b70-4271ed8fb0fe tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Request method failure captured: Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f HTTP/1.1 Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHESXQxpcufI-CUSWUilmcsaZJqeGTZ1XSJhK3cOKQSHfR7SOqpJXB5gI7IO1ZJ7MF2R3IqyWF2TibK_8E5M0a1-siahVPG9PVUIliWTN_1rBAmftyVxarmhF0AFAhPwaxNbXp_KtpWCZNkHYD5hu4Qhudt2MPJ0SEdJjDq91t-zHw Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:26:10.924926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24dc0fdb55324beca6e1af076c0fcd20", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: ddb92150d9be4326b613600de6aeb66b Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Snapshot 86c67057-0503-4708-9b6c-6e3f8ff32d3f could not be found. Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '86c67057-0503-4708-9b6c-6e3f8ff32d3f'} Aug 07 19:26:10.926057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 86c67057-0503-4708-9b6c-6e3f8ff32d3f could not be found. (HTTP 404) (Request-ID: req-d05954d0-ed2b-402c-9be2-32a29e349c1f) Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:10.926830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:10.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 86c67057-0503-4708-9b6c-6e3f8ff32d3f could not be found. Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 07 19:26:10.929460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 86c67057-0503-4708-9b6c-6e3f8ff32d3f could not be found. Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 86c67057-0503-4708-9b6c-6e3f8ff32d3f could not be found. Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a6560580-6e46-4a10-8b70-4271ed8fb0fe tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Returning 404 to user: Snapshot 86c67057-0503-4708-9b6c-6e3f8ff32d3f could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a6560580-6e46-4a10-8b70-4271ed8fb0fe tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f" status: 404 len: 111 microversion: 2.1 time: 0.090107 Aug 07 19:26:10.930767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 10/18] 10.222.0.17 () {58 vars in 1251 bytes} [Sun Aug 7 19:26:10 2022] GET /compute/v2.1/os-snapshots/86c67057-0503-4708-9b6c-6e3f8ff32d3f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:26:10.951756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79cf7bae-9d9a-47a1-9860-159793686680 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cadb5e0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:11.169919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-79cf7bae-9d9a-47a1-9860-159793686680 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49" status: 202 len: 0 microversion: 2.1 time: 0.234189 Aug 07 19:26:11.170493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 11/19] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:26:10 2022] DELETE /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:26:11.179400 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f1cd40a-50d6-4059-9755-eef696d0ddbc tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cadbca0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:11.281770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f1cd40a-50d6-4059-9755-eef696d0ddbc tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49" status: 200 len: 345 microversion: 2.1 time: 0.106153 Aug 07 19:26:11.282613 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 12/20] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:11 2022] GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:11.325935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-784772e3-b115-467b-a810-aa4652e826a0 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47cadba60>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:11.469767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-784772e3-b115-467b-a810-aa4652e826a0 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c06a3d91-4f88-493e-9024-5f0966b512b9" status: 200 len: 350 microversion: 2.1 time: 0.147105 Aug 07 19:26:11.469957 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 13/21] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:11 2022] GET /compute/v2.1/os-volumes/c06a3d91-4f88-493e-9024-5f0966b512b9 => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:26:11.484647 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6535fc0-a98e-4193-b669-ef8b80217c0a tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47cadb310>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:11.762249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e6535fc0-a98e-4193-b669-ef8b80217c0a tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.282272 Aug 07 19:26:11.762821 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 14/22] 10.222.0.17 () {58 vars in 1134 bytes} [Sun Aug 7 19:26:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:11.801845 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b88af2b3-fdf0-4afe-80e9-cb9a0c0cd789 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47cb755e0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:12.119965 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-843386762", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "networks": [{"uuid": "f129e7ab-1537-4605-9c77-1ce3db752be6"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:12.245034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b88af2b3-fdf0-4afe-80e9-cb9a0c0cd789 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.448414 Aug 07 19:26:12.246650 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 15/23] 10.222.0.17 () {58 vars in 1149 bytes} [Sun Aug 7 19:26:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:12.270989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d48bbacb-ec71-4c5a-86bd-a491fb8ae604 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47cb75940>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:12.481035 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d48bbacb-ec71-4c5a-86bd-a491fb8ae604 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213840 Aug 07 19:26:12.483114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 16/24] 10.222.0.17 () {58 vars in 1134 bytes} [Sun Aug 7 19:26:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:12.527663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c0506309-3090-4325-9b64-3a4d5ddb19c8 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cadb040>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:12.550850 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] validate_networks() for [('f129e7ab-1537-4605-9c77-1ce3db752be6', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:26:12.722279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-c0506309-3090-4325-9b64-3a4d5ddb19c8 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] HTTP exception thrown: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c0506309-3090-4325-9b64-3a4d5ddb19c8 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Request method failure captured: Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 HTTP/1.1 Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHESXQxpcufI-CUSWUilmcsaZJqeGTZ1XSJhK3cOKQSHfR7SOqpJXB5gI7IO1ZJ7MF2R3IqyWF2TibK_8E5M0a1-siahVPG9PVUIliWTN_1rBAmftyVxarmhF0AFAhPwaxNbXp_KtpWCZNkHYD5hu4Qhudt2MPJ0SEdJjDq91t-zHw Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:26:12.727322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24dc0fdb55324beca6e1af076c0fcd20", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: ddb92150d9be4326b613600de6aeb66b Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'dc451db1-ac00-417a-a75f-d68fd1d46d49'} Aug 07 19:26:12.729395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. (HTTP 404) (Request-ID: req-8e7cd344-4fef-406e-b613-1bfadd68f3b1) Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:12.730599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:12.735618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 19:26:12.737563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:12.739275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:12.748027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c0506309-3090-4325-9b64-3a4d5ddb19c8 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Returning 404 to user: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:26:12.748027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c0506309-3090-4325-9b64-3a4d5ddb19c8 tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49" status: 404 len: 109 microversion: 2.1 time: 0.261601 Aug 07 19:26:12.748027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 17/25] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:12 2022] GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 => generated 109 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:26:12.781723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-103255c9-f6a4-4b33-90bc-f000af9370ed tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47d4e7040>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:13.144789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-103255c9-f6a4-4b33-90bc-f000af9370ed tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.388263 Aug 07 19:26:13.147164 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 18/26] 10.222.0.17 () {58 vars in 1167 bytes} [Sun Aug 7 19:26:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:13.151982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e5de7013-9a11-493a-96b2-31ec6d52785d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47cadb790>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:13.357031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-e5de7013-9a11-493a-96b2-31ec6d52785d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] HTTP exception thrown: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e5de7013-9a11-493a-96b2-31ec6d52785d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Request method failure captured: Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 HTTP/1.1 Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHESXQxpcufI-CUSWUilmcsaZJqeGTZ1XSJhK3cOKQSHfR7SOqpJXB5gI7IO1ZJ7MF2R3IqyWF2TibK_8E5M0a1-siahVPG9PVUIliWTN_1rBAmftyVxarmhF0AFAhPwaxNbXp_KtpWCZNkHYD5hu4Qhudt2MPJ0SEdJjDq91t-zHw Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:26:13.360558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24dc0fdb55324beca6e1af076c0fcd20", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: ddb92150d9be4326b613600de6aeb66b Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'dc451db1-ac00-417a-a75f-d68fd1d46d49'} Aug 07 19:26:13.361632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. (HTTP 404) (Request-ID: req-1cae1d4c-2893-408b-9461-5e5a6bf43ec2) Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:13.362236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 19:26:13.363087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 19:26:13.365089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e5de7013-9a11-493a-96b2-31ec6d52785d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Returning 404 to user: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e5de7013-9a11-493a-96b2-31ec6d52785d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49" status: 404 len: 109 microversion: 2.1 time: 0.214156 Aug 07 19:26:13.367549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 19/27] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:26:13 2022] DELETE /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 => generated 109 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:26:13.384875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ca556573-5021-445d-89da-eb130c52d329 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47cadbc10>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:13.826227 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ca556573-5021-445d-89da-eb130c52d329 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.455121 Aug 07 19:26:13.826884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 20/28] 10.222.0.17 () {58 vars in 1170 bytes} [Sun Aug 7 19:26:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:14.387661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1113590422", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:14.620563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] validate_networks() for [('6f7ad20a-0a66-4922-a403-e50e551ba485', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:26:15.395419 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:26:15.396450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:26:15.397490 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:26:15.398924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:26:15.399827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:26:15.425475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:15.426480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:15.427385 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:15.429223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:15.430477 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:15.431983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:15.514230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Getting quotas for project d300969a86954ad7ab74b743e72bcaf1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:26:15.531917 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Getting quotas for user 5ce40a75512a4ff9971552ffc54136c3 and project d300969a86954ad7ab74b743e72bcaf1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:26:15.593278 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:26:15.606012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:26:15.884437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ea9e04e5-78f5-4af7-bc91-7c6199bcff42 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.971130 Aug 07 19:26:15.885852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 9/29] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:26:15.894104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-05f70081-006a-40e5-b008-da17c5991b4d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Calling method '.version_select at 0x7fd47c28bdc0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:16.042143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-05f70081-006a-40e5-b008-da17c5991b4d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] HTTP exception thrown: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-05f70081-006a-40e5-b008-da17c5991b4d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Request method failure captured: Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 HTTP/1.1 Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHESXQxpcufI-CUSWUilmcsaZJqeGTZ1XSJhK3cOKQSHfR7SOqpJXB5gI7IO1ZJ7MF2R3IqyWF2TibK_8E5M0a1-siahVPG9PVUIliWTN_1rBAmftyVxarmhF0AFAhPwaxNbXp_KtpWCZNkHYD5hu4Qhudt2MPJ0SEdJjDq91t-zHw Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:26:16.065487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24dc0fdb55324beca6e1af076c0fcd20", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24dc0fdb55324beca6e1af076c0fcd20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 24dc0fdb55324beca6e1af076c0fcd20 Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842506061 Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: ddb92150d9be4326b613600de6aeb66b Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842506061-project Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'dc451db1-ac00-417a-a75f-d68fd1d46d49'} Aug 07 19:26:16.066728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. (HTTP 404) (Request-ID: req-66bbe13d-984c-435f-aabf-0bf47c1d4eb5) Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:16.067408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:16.068397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 19:26:16.069326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-05f70081-006a-40e5-b008-da17c5991b4d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] Returning 404 to user: Volume dc451db1-ac00-417a-a75f-d68fd1d46d49 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-05f70081-006a-40e5-b008-da17c5991b4d tempest-VolumesSnapshotsTestJSON-842506061 tempest-VolumesSnapshotsTestJSON-842506061-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49" status: 404 len: 109 microversion: 2.1 time: 0.180121 Aug 07 19:26:16.070226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 10/30] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:15 2022] GET /compute/v2.1/os-volumes/dc451db1-ac00-417a-a75f-d68fd1d46d49 => generated 109 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:26:16.086985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a1dbeed2-9552-47f8-a050-b2f2e286a5be tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47c1981f0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:16.295849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a1dbeed2-9552-47f8-a050-b2f2e286a5be tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.226601 Aug 07 19:26:16.296493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 11/31] 10.222.0.17 () {58 vars in 1155 bytes} [Sun Aug 7 19:26:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:17.243176 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e5ed0f1b-6c11-4a0d-8895-0eec3ab86a29 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'create', calling method: .version_select at 0x7fd47c215310>, body: {"keypair": {"name": "tempest-keypair-418294533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdRsapMlbVLtsYgzwon9ksxEvGr3kT3kX6uv54Pje3RO+Xo68aiuD2xiHWt7naNDonJGopWLbdl5++3uJulYIvSr/27QcOSVmmmESrc5uwpMegmC55GdEOdGB9k7ikFMw=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:17.283924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:26:17.285913 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:26:17.289031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:26:17.289553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:26:17.291712 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:26:17.301679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e5ed0f1b-6c11-4a0d-8895-0eec3ab86a29 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for project fcf93b388fac4be38661d185a7231937. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:26:17.324598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e5ed0f1b-6c11-4a0d-8895-0eec3ab86a29 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for user 6732487041c54918b1164b1cb72bb07e and project fcf93b388fac4be38661d185a7231937. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:26:17.360305 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:17.361239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:17.363223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:17.364310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:17.368279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:17.373104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:17.440472 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e5ed0f1b-6c11-4a0d-8895-0eec3ab86a29 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.142777 Aug 07 19:26:17.451826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 12/32] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:26:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:17.478191 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1075553799", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc78dd60-2af8-48f0-9dbc-66b27c087d3d"}], "security_groups": [{"name": "tempest-securitygroup--2048133154"}], "key_name": "tempest-keypair-1221461059", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:17.480421 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:26:17.503820 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for user f643fd4ee6bc4ccfae45f3b8523ae46a and project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:26:17.556886 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:26:17.560682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:26:17.869900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-77ff3cf5-a3f2-4634-82e2-8801074fd84e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.026165 Aug 07 19:26:17.877364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 21/33] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:26:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 4050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:26:17.911655 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-77cc3a69-0bb8-46ac-a4e7-501736380c63 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:17.916961 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77cc3a69-0bb8-46ac-a4e7-501736380c63 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:17.992533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] validate_networks() for [('fc78dd60-2af8-48f0-9dbc-66b27c087d3d', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:26:18.904359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77cc3a69-0bb8-46ac-a4e7-501736380c63 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:18.932469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-77cc3a69-0bb8-46ac-a4e7-501736380c63 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1214 microversion: 2.1 time: 1.041287 Aug 07 19:26:18.946981 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 22/34] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:17 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1214 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:18.953099 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d36fca6c-ef95-4c86-ac50-24fff919f14d tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47c1f5e50>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:19.123017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d36fca6c-ef95-4c86-ac50-24fff919f14d tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.174420 Aug 07 19:26:19.123963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 23/35] 10.222.0.17 () {58 vars in 1188 bytes} [Sun Aug 7 19:26:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:19.130676 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b210342d-d263-4a1e-a19e-c83e192fb854 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:19.131580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b210342d-d263-4a1e-a19e-c83e192fb854 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:19.415258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b210342d-d263-4a1e-a19e-c83e192fb854 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:19.434982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b210342d-d263-4a1e-a19e-c83e192fb854 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1222 microversion: 2.1 time: 0.308284 Aug 07 19:26:19.464427 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 24/36] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:19 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:19.476131 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7bc1f438-29d9-475f-bd52-c1422a328fc9 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] Calling method '.version_select at 0x7fd47c1a20d0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:19.656659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7bc1f438-29d9-475f-bd52-c1422a328fc9 tempest-VolumesTestJSON-1351454616 tempest-VolumesTestJSON-1351454616-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.187557 Aug 07 19:26:19.657560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 25/37] 10.222.0.17 () {58 vars in 1155 bytes} [Sun Aug 7 19:26:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:19.785567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-539841839", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:19.908795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] validate_networks() for [('6f7ad20a-0a66-4922-a403-e50e551ba485', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:26:20.790225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:26:20.790793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:26:20.791256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:26:20.791676 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:26:20.792237 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:26:20.807706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:20.808726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:20.809392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:20.810355 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:20.811083 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:20.811646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:20.841372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:26:20.851490 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:26:20.874147 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:26:20.878449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:26:21.054607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c10d59ec-fd15-4ec3-b65f-6faadd84a89e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.611384 Aug 07 19:26:21.058030 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 13/38] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:26:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:26:21.076859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:21.081556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:21.132811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:21.134887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:21.135588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:21.137160 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:21.140013 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:21.141239 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:21.448520 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:21.504496 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4723679a-dec7-44ac-a447-c20a8b16e6b5 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1266 microversion: 2.1 time: 0.439744 Aug 07 19:26:21.523002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 14/39] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:21 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:21.529321 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e20d8f6c-3bc4-45bf-85d3-1022ad1438ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:21.530163 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e20d8f6c-3bc4-45bf-85d3-1022ad1438ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:21.841111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e20d8f6c-3bc4-45bf-85d3-1022ad1438ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:21.943079 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e20d8f6c-3bc4-45bf-85d3-1022ad1438ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1242 microversion: 2.1 time: 0.412297 Aug 07 19:26:21.950061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 15/40] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:21 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1242 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:21.959954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:26:21.964061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:26:21.964565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:26:21.964986 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:26:21.965411 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:26:21.984978 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:21.985485 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:21.985990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:22.006291 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:22.007914 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:22.012735 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:22.068284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:26:22.074337 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for user f643fd4ee6bc4ccfae45f3b8523ae46a and project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:26:22.107368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:26:22.127265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:26:22.245271 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9f3bd471-fbdb-4988-beb0-0f2e88c51dc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.464592 Aug 07 19:26:22.246386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 26/41] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:26:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 19:26:22.257964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8ecbd1b9-0dde-4b1f-884c-5bcfbbf6140e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:22.258583 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8ecbd1b9-0dde-4b1f-884c-5bcfbbf6140e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:22.529547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:22.530277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:22.561120 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:22.564445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:22.566154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:22.567198 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:22.571382 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:22.573854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:22.988486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8ecbd1b9-0dde-4b1f-884c-5bcfbbf6140e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:22.998305 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8ecbd1b9-0dde-4b1f-884c-5bcfbbf6140e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1221 microversion: 2.1 time: 0.744449 Aug 07 19:26:23.002308 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 16/42] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:22 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1221 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:23.020189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:23.020815 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:23.031586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:23.053133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:23.053665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:23.062833 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:23.070071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:23.071366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:23.075913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:23.080214 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-765fbd28-cdb6-4a5a-9fb0-ab0f31f3aae7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1272 microversion: 2.1 time: 0.555365 Aug 07 19:26:23.084434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 27/43] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:22 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1272 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:23.821459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:23.834799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1b411936-b779-4548-a303-f54a456be6a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1238 microversion: 2.1 time: 0.830798 Aug 07 19:26:23.849062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 17/44] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:23 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1238 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:24.022823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:24.023582 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:24.036830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:24.037496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:24.040178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:24.041095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:24.049515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:24.054852 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:24.110270 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:24.111822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:24.138109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:24.142190 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:24.146150 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:24.150785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:24.164325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:24.165459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:24.951233 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:24.966834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:24.973460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-515968d8-6662-4236-85c8-b48eaf417650 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1217 microversion: 2.1 time: 0.952915 Aug 07 19:26:24.975889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2566155d-85c8-47d9-92ba-5c2ca2bd162d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1272 microversion: 2.1 time: 0.870213 Aug 07 19:26:24.977719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 28/45] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:24 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1217 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:25.007875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 18/46] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:24 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1272 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:25.015405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-356483205", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf733bd5-517a-49a5-a4fd-6f494e57a979"}], "security_groups": [{"name": "tempest-securitygroup--1844267384"}], "key_name": "tempest-keypair-418294533", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:25.019867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:25.033012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:25.054961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:25.060222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:25.062299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:25.065144 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:25.071277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:25.072027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:25.469449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:25.488810 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-73578e92-f1f7-46a3-b69d-474bb47aac6a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1300 microversion: 2.1 time: 0.477836 Aug 07 19:26:25.489678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 19/47] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:25 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1300 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:25.995373 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] validate_networks() for [('bf733bd5-517a-49a5-a4fd-6f494e57a979', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:26:26.013651 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:26.014554 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:26.039247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:26.065689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:26.069980 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:26.076095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:26.085764 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:26.092695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:27.851726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:27.890161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e37441b8-d624-444f-a7c9-481ab2b8f76c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 1.885458 Aug 07 19:26:27.929092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 20/48] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:26 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:27.937816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:27.952884 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:27.970867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:27.971360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:28.002611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:28.007728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:28.009467 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:28.010223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:28.283794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:28.323690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad2c4ac4-6e2c-48ac-887a-6ffbb26c8724 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1279 microversion: 2.1 time: 0.388115 Aug 07 19:26:28.337813 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 21/49] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:27 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1279 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:28.352107 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:28.354451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:28.386832 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:28.388675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:28.391001 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:28.397855 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:28.399487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:28.400921 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:28.829865 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:28.896066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3193b210-50db-4fc8-a94f-853d7b6e96a0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1300 microversion: 2.1 time: 0.550107 Aug 07 19:26:28.902219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 22/50] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:28 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1300 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:29.216857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:26:29.218021 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:26:29.220275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:26:29.221349 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:26:29.222123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:26:29.243097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:29.246501 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:29.249394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:29.250703 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:29.254333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:29.257400 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:29.319774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for project fcf93b388fac4be38661d185a7231937. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:26:29.325552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for user 6732487041c54918b1164b1cb72bb07e and project fcf93b388fac4be38661d185a7231937. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:26:29.354923 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:26:29.358911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:26:29.452813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d3b32438-39aa-4961-94a2-1dc797de4445 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.473554 Aug 07 19:26:29.453643 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 29/51] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:26:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 4475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:26:29.465276 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:29.469407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:29.479443 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:29.480375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:29.481211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:29.481781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:29.482403 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:29.482936 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:29.799539 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5ec3a5ab-75e9-46ef-887e-2383cf55c4e9 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] Action: 'create', calling method: .version_select at 0x7fd47c102e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1203757777", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:30.826688 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:30.900161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5ec3a5ab-75e9-46ef-887e-2383cf55c4e9 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.992903 Aug 07 19:26:30.901566 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 23/52] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Aug 7 19:26:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1998 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 19:26:30.912404 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:30.913306 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:30.939985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:30.943044 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:30.945122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:30.946372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:30.947182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:30.967897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:31.744444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:31.777017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-94ea9b10-1e28-4b65-9c89-664013c79ceb tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 2.321819 Aug 07 19:26:31.778544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 30/53] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:29 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:31.791962 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:31.792744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:31.836156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:31.836659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:31.837104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:31.837843 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:31.838311 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:31.838743 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:32.072325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:32.085735 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d6fdf03-7970-4dbc-8dbf-cde96697efad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 1.180795 Aug 07 19:26:32.086397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 24/54] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:30 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:32.113238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:32.114445 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:32.138544 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:32.145096 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:32.145835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:32.148175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:32.153572 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:32.154061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:32.154869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:32.545326 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:32.554119 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7ac202a3-e691-4236-906a-799bedf55aa3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1288 microversion: 2.1 time: 0.773182 Aug 07 19:26:32.554630 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 31/55] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:31 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1288 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:32.617603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f2b9843-eabb-477b-85c9-c0986484be65 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] Calling method '.version_select at 0x7fd47c0fa430>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:32.814276 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f2b9843-eabb-477b-85c9-c0986484be65 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c" status: 200 len: 354 microversion: 2.1 time: 0.224231 Aug 07 19:26:32.816022 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 32/56] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:32 2022] GET /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c => generated 354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:32.838633 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:32.841966 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:32.870350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:32.871058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:32.871731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:32.872663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:32.873221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:32.877308 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:32.994430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=24 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:33.837217 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:33.862488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2320ca73-ed01-4c79-9ae4-69b1d89c23fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 1.757627 Aug 07 19:26:33.863895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 25/57] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:32 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:33.883630 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b03c8b44-17dd-4ad2-95a2-bfbeb023058d tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] Calling method '.version_select at 0x7fd47c113550>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:34.037284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b03c8b44-17dd-4ad2-95a2-bfbeb023058d tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c" status: 200 len: 354 microversion: 2.1 time: 0.171601 Aug 07 19:26:34.039769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 26/58] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:33 2022] GET /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:34.052685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:34.056953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:34.073102 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:34.075652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:34.081230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:34.082321 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:34.083103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:34.083715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:34.508976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:34.521708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1b7b5363-9267-4158-b9b7-b8d5b54e75f7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 1.703905 Aug 07 19:26:34.539442 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 33/59] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:32 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:34.551337 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:34.558291 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:34.586287 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:34.590010 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:34.596491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:34.597305 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:34.597806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:34.598230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:35.156728 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:35.190908 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-933abad4-8d25-4e9f-b8bc-2691efbe1ff2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1294 microversion: 2.1 time: 0.655519 Aug 07 19:26:35.198602 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 34/60] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:34 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1294 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:35.207690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-540dd413-f8e7-4e48-b9c2-7f199b7c4207 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] Calling method '.version_select at 0x7fd47c152e50>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:35.398321 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-540dd413-f8e7-4e48-b9c2-7f199b7c4207 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c" status: 202 len: 0 microversion: 2.1 time: 0.197698 Aug 07 19:26:35.402060 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 35/61] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:26:35 2022] DELETE /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:26:35.407396 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:35.408307 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:35.435973 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:35.439142 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:35.439893 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:35.442632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:35.443735 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:35.445744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:35.688187 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:35.719451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b115a12f-ea37-40b8-a6b0-fbaaa9370f56 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 1.677671 Aug 07 19:26:35.720925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 27/62] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:34 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:35.736345 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8dcf2a03-7081-4d75-8059-1585d4854fa7 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] Calling method '.version_select at 0x7fd47c1139d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:35.827094 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-8dcf2a03-7081-4d75-8059-1585d4854fa7 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] HTTP exception thrown: Volume d17be0ea-e260-41a7-b83e-c9666dc23c8c could not be found. Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8dcf2a03-7081-4d75-8059-1585d4854fa7 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] Request method failure captured: Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c HTTP/1.1 Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHijgLPpd1MNZYu8_soIFVUoFbSqbes-CiaYf-jlDVO4BetWIo-CLdzCJk31BqyOwa076chNGRijTSzwAQExAAKMNdOQr9nL0zGnQmPU5VQZ7tdA-UyneNgXPDP9jgN-xcTANNcyeo319hIVz67BfbQDiNRwOGikUaaLk0Vsnb57yY Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: d6007723a068405d9032c43177fe5097 Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesGetTestJSON-605421738 Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:26:35.829139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6007723a068405d9032c43177fe5097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6007723a068405d9032c43177fe5097", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6007723a068405d9032c43177fe5097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6007723a068405d9032c43177fe5097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesGetTestJSON-605421738 Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d6007723a068405d9032c43177fe5097 Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesGetTestJSON-605421738 Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesGetTestJSON-605421738-project Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: a0b2a4d397f14de2b8164761d03a1258 Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesGetTestJSON-605421738-project Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Volume d17be0ea-e260-41a7-b83e-c9666dc23c8c could not be found. Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd17be0ea-e260-41a7-b83e-c9666dc23c8c'} Aug 07 19:26:35.831650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d17be0ea-e260-41a7-b83e-c9666dc23c8c could not be found. (HTTP 404) (Request-ID: req-1e835e74-d6dc-4b3b-8858-e5cd9b864931) Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:35.833183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:26:35.835357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d17be0ea-e260-41a7-b83e-c9666dc23c8c could not be found. Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 19:26:35.837632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d17be0ea-e260-41a7-b83e-c9666dc23c8c could not be found. Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d17be0ea-e260-41a7-b83e-c9666dc23c8c could not be found. Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8dcf2a03-7081-4d75-8059-1585d4854fa7 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] Returning 404 to user: Volume d17be0ea-e260-41a7-b83e-c9666dc23c8c could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8dcf2a03-7081-4d75-8059-1585d4854fa7 tempest-VolumesGetTestJSON-605421738 tempest-VolumesGetTestJSON-605421738-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c" status: 404 len: 109 microversion: 2.1 time: 0.108555 Aug 07 19:26:35.839782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 28/63] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:26:35 2022] GET /compute/v2.1/os-volumes/d17be0ea-e260-41a7-b83e-c9666dc23c8c => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:26:35.841460 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:35.841460 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:35.870375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:35.870816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:35.871188 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:35.871899 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:35.873329 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:35.894945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:37.120784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:37.133938 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1985dfce-e692-4be2-9eb0-6b5c05e7010c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 1.300921 Aug 07 19:26:37.150412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 29/64] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:35 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:37.164682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:37.191955 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-429e7bcb-bf65-463f-bae7-1c49941a96ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 1.785881 Aug 07 19:26:37.195311 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 36/65] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:35 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:37.213748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:37.222835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:37.241836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:37.249075 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:37.250358 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:37.251519 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:37.256130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:37.257048 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:37.563397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-19daf44d-bbc8-4993-9834-c88e6b3c3439 req-f92da28c-a026-43be-aa1b-30a055d506c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acd4751-94cc-4386-8cfc-e47567370bae", "tag": "55fc6e17-2465-45a4-a50b-0bf3ff58fe40"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:37.638739 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-19daf44d-bbc8-4993-9834-c88e6b3c3439 req-f92da28c-a026-43be-aa1b-30a055d506c2 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:37.641788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-19daf44d-bbc8-4993-9834-c88e6b3c3439 req-f92da28c-a026-43be-aa1b-30a055d506c2 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:37.642703 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-19daf44d-bbc8-4993-9834-c88e6b3c3439 req-f92da28c-a026-43be-aa1b-30a055d506c2 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:37.695808 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-19daf44d-bbc8-4993-9834-c88e6b3c3439 req-f92da28c-a026-43be-aa1b-30a055d506c2 service nova] Creating event network-changed:55fc6e17-2465-45a4-a50b-0bf3ff58fe40 for instance 5acd4751-94cc-4386-8cfc-e47567370bae on hv-cinder-85032 Aug 07 19:26:37.697219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-19daf44d-bbc8-4993-9834-c88e6b3c3439 req-f92da28c-a026-43be-aa1b-30a055d506c2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 19:26:37.698554 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-19daf44d-bbc8-4993-9834-c88e6b3c3439 req-f92da28c-a026-43be-aa1b-30a055d506c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 19:26:37.703160 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:37.703956 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:37.704725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:37.709455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:37.710301 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:37.710964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:37.743466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.compute.rpcapi [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 19:26:37.744561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] Releasing lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 19:26:37.783401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5236338f-efc1-4198-be93-b3841aed6b43 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.631152 Aug 07 19:26:37.784292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 30/66] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:37.960375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:37.976522 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-643917de-4b47-4172-a965-c4f3cbb218ae req-8fc20627-cad0-4830-9ab9-72169965d2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e6588b5-4e24-43a6-a8d1-b40fdbe40a08", "tag": "734927af-232f-4ebf-acd0-0602c7c0911b"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:37.992955 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-afdff5cc-f0f0-4d24-b523-e841ec1af60d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1294 microversion: 2.1 time: 0.794371 Aug 07 19:26:38.020569 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 37/67] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:37 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1294 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:38.029942 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:38.030263 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-643917de-4b47-4172-a965-c4f3cbb218ae req-8fc20627-cad0-4830-9ab9-72169965d2c3 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:38.030450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-643917de-4b47-4172-a965-c4f3cbb218ae req-8fc20627-cad0-4830-9ab9-72169965d2c3 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:38.030938 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-643917de-4b47-4172-a965-c4f3cbb218ae req-8fc20627-cad0-4830-9ab9-72169965d2c3 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:38.032731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:38.035937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:38.050808 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:38.053667 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:38.054434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:38.055333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:38.056237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:38.056909 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:38.065845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-643917de-4b47-4172-a965-c4f3cbb218ae req-8fc20627-cad0-4830-9ab9-72169965d2c3 service nova] Creating event network-changed:734927af-232f-4ebf-acd0-0602c7c0911b for instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 on hv-cinder-85032 Aug 07 19:26:38.077224 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-643917de-4b47-4172-a965-c4f3cbb218ae req-8fc20627-cad0-4830-9ab9-72169965d2c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289502 Aug 07 19:26:38.081369 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 31/68] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:38.156656 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:38.158243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:38.173609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:38.174493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:38.175210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:38.176455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:38.177147 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:38.177942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:38.571798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:38.584940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3d0b9349-1c31-499c-9da7-a27e1933dbad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.561802 Aug 07 19:26:38.588919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 38/69] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:38 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:38.599126 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:38.600159 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:38.616108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:38.617055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:38.618898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:38.621256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:38.622885 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:38.624259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:38.639463 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:38.660932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eee30374-4625-4532-b406-3152b8e6f11f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.506871 Aug 07 19:26:38.665971 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 32/70] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:38 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:39.026213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:39.027298 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:39.040744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:39.046218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:39.049399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:39.049854 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:39.050759 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:39.051913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:39.052607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:39.056985 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c092e331-32cc-43f6-b568-f849940196a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.466114 Aug 07 19:26:39.059701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 39/71] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:38 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:39.135189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:39.143959 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c2423aa8-a67f-4607-b2f9-d53bf35d3da7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1294 microversion: 2.1 time: 0.122638 Aug 07 19:26:39.144570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 33/72] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:39 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:39.622664 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:39.625293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:39.645277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:39.646592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=22 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:39.648768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:39.649540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:39.650460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:39.651753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:39.652481 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:39.659345 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:39.698391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:39.701790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:39.744805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:39.750563 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:39.754240 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:39.757976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:39.770380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:39.772507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.062754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:40.078023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-70c7b3fb-c37f-49ff-b0c2-d02cdc6ae96f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.469280 Aug 07 19:26:40.078733 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 40/73] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:39 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:40.096525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab31f7bc-2dfc-4b03-8e02-37f4ac156634", "tag": "ec5e8929-117c-45be-bbd1-05e5980f7c7a"}, {"name": "network-changed", "server_uuid": "280a2b69-299a-4b09-97df-07cc251437a7", "tag": "872ec0ba-2832-4ac2-8bfe-ef80b10fb5af"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:40.126422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:40.131703 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:40.132265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.151957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:40.157762 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Creating event network-changed:ec5e8929-117c-45be-bbd1-05e5980f7c7a for instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 on hv-cinder-85032 Aug 07 19:26:40.158444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Creating event network-changed:872ec0ba-2832-4ac2-8bfe-ef80b10fb5af for instance 280a2b69-299a-4b09-97df-07cc251437a7 on hv-cinder-85032 Aug 07 19:26:40.158974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 19:26:40.159900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-55bc1dce-a044-4892-a70a-101c9103cc2b req-953c2a7f-4d8d-4298-997b-78f8e391d1f3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 19:26:40.161153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:40.162050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:40.163215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.164111 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:40.164709 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:40.165271 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.165949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1cc0e378-9fef-40bd-b19d-0c613abe36f4 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.480733 Aug 07 19:26:40.167271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 34/74] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:39 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:40.183512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:40.188548 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:40.193820 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.compute.rpcapi [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 19:26:40.197195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] Releasing lock "compute-rpcapi-router" {{(pid=117833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 19:26:40.205090 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:40.205589 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:40.206028 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.206742 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:40.207197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:40.208687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.227679 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0bf4ee55-ff79-43e0-b341-80b0993cf705 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.147382 Aug 07 19:26:40.228441 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 41/75] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:40.234547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:40.235249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:40.242140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:40.243016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:40.243731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.244691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:40.245293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:40.245859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:40.652893 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:40.664925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fa95bfee-676a-4814-b7b6-aae61384be93 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.434904 Aug 07 19:26:40.665504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 42/76] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:40 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:40.666945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:40.681637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:40.688256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ff1cef46-a28e-480c-bc74-3c3c8e8e43ae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.513630 Aug 07 19:26:40.690008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 35/77] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:40 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:41.104375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:41.104375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:41.109109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.109591 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.110231 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.110992 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.111682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.112249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.199517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:41.200777 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:41.207720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.208442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.209330 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.210206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.210829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.211430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.271764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:41.284293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3d976379-f067-4bdb-a9b4-54b82af4a3f0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.187985 Aug 07 19:26:41.284911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 43/78] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:41 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:41.480745 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:41.494551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-020f1039-c923-4bcc-a252-556fc5de607e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.299404 Aug 07 19:26:41.496293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 36/79] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:41 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:41.686925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:41.687700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:41.694512 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.695260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.695933 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.697192 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.697989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.698636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.711383 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:41.712575 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:41.719872 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.721644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.722284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.723402 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:41.723940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:41.724393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:41.958894 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:41.969629 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f90f0693-f2e9-40fc-8a06-f0214f9e360f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.286048 Aug 07 19:26:41.972513 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 44/80] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:41 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:42.025625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:42.033820 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-904fbcf7-15bb-44a2-8970-a9c1f62e3923 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.326883 Aug 07 19:26:42.035047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 37/81] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:41 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:42.307778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:42.308630 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:42.314936 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:42.315666 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:42.316332 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:42.317350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:42.318047 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:42.318770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:42.528290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:42.529273 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:42.548428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:42.549805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:42.552178 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:42.556828 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:42.557582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:42.558238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:42.594692 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:42.627713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:42.631147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b655552b-10d3-4050-956d-706ec7c6678b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.327606 Aug 07 19:26:42.632732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 45/82] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:42 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:42.939033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:42.948718 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-314a9c6b-a75e-4ae7-8bc2-cf83192c5686 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.426490 Aug 07 19:26:42.949319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 38/83] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:42 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:42.995397 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:42.996156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:43.016884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:43.018099 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:43.018549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:43.020981 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:43.021625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:43.024448 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:43.059350 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:43.060350 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:43.074805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:43.077258 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:43.079920 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:43.081441 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:43.082689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:43.085977 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:43.475618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:43.485903 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-23c1b0e1-90c7-454e-96d7-ca200808a22b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.494848 Aug 07 19:26:43.500126 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 46/84] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:42 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:43.505202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-94334c06-3d34-4e27-9a5e-64965f163fdb req-12a63f5e-ae10-4ce0-ba00-83093ca83388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7", "tag": "539ffdda-b91d-4657-ac08-52d85aa595d6"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:43.514892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-94334c06-3d34-4e27-9a5e-64965f163fdb req-12a63f5e-ae10-4ce0-ba00-83093ca83388 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:43.515364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-94334c06-3d34-4e27-9a5e-64965f163fdb req-12a63f5e-ae10-4ce0-ba00-83093ca83388 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:43.515785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-94334c06-3d34-4e27-9a5e-64965f163fdb req-12a63f5e-ae10-4ce0-ba00-83093ca83388 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:43.537374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-94334c06-3d34-4e27-9a5e-64965f163fdb req-12a63f5e-ae10-4ce0-ba00-83093ca83388 service nova] Creating event network-changed:539ffdda-b91d-4657-ac08-52d85aa595d6 for instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 on hv-cinder-85032 Aug 07 19:26:43.546916 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-94334c06-3d34-4e27-9a5e-64965f163fdb req-12a63f5e-ae10-4ce0-ba00-83093ca83388 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045274 Aug 07 19:26:43.548577 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 47/85] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:43.571714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:43.595875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d47a15c2-225b-4aa5-9e02-8658e90c00a6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.541517 Aug 07 19:26:43.601709 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 39/86] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:43 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:43.666215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:43.667152 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:43.676412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:43.677213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:43.677966 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:43.678829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:43.679646 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:43.680317 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:43.958445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:43.968963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-48c5872c-9416-468c-b0ee-bfe57895469f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.308936 Aug 07 19:26:43.970131 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 48/87] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:43 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:43.987421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:43.988351 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:43.995697 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:44.000919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:44.005340 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:44.006389 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:44.007128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:44.007783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:44.409571 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:44.423264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b47a82f9-e577-4fb9-85c3-4aedcae939af tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.437216 Aug 07 19:26:44.425153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 40/88] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:43 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:44.507083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:44.507691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:44.518905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:44.520500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:44.521425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:44.524493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:44.525951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:44.526797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:44.623250 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:44.624558 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:44.635236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:44.635967 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:44.640022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:44.641746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:44.642599 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:44.643510 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:44.976153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:44.999209 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4b6a9a95-79c2-469c-9f66-fcc67e4bedce tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.495581 Aug 07 19:26:45.001928 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 49/89] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:44 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:45.025689 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:45.027378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:45.042545 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:45.043661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:45.046395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:45.048422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:45.049872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:45.051155 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:45.059619 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:45.067540 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0a4143f5-cf2d-42ab-a350-82d9abfcb7c0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.448355 Aug 07 19:26:45.088320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 41/90] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:44 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:45.302070 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:45.311396 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e1f2bf23-155f-4cf6-adac-d82f1b9d220a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.307339 Aug 07 19:26:45.328072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 50/91] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:45 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:45.447770 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:45.448417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:45.456300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:45.456815 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:45.457194 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:45.457907 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:45.458476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:45.459092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:45.698469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:45.714786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e5a1df98-7397-4de3-ad50-fc15ed70729a tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.271610 Aug 07 19:26:45.716534 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 42/92] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:45 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:46.026814 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:46.027870 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:46.037284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.039157 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.039675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.040442 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.044059 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.044864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.108785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:46.111089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:46.141897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.142405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.142847 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.143778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.150174 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.151284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.441754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:46.450565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-27537163-8594-4576-b04b-f363430440a7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.431944 Aug 07 19:26:46.460145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 51/93] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:46 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:46.462341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:46.463395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:46.477502 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:46.488091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.489128 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.489748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.490667 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.491381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.492020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.494276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-19e2873e-d240-43dc-b454-9453e3714227 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.401853 Aug 07 19:26:46.495524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 43/94] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:46 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:46.709015 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:46.720149 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-87aaa5d3-21af-4e37-9937-630075d54ac8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.260568 Aug 07 19:26:46.721351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 52/95] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:46 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:46.740280 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:46.741513 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:46.750107 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.750830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.751504 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.752476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:46.753173 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:46.753949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:46.958286 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:46.968943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9af513fa-a458-4132-a513-4360accff6c8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.232643 Aug 07 19:26:46.981365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 44/96] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:46 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:47.479540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:47.481680 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:47.489375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:47.489986 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:47.491015 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:47.492982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:47.493960 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:47.494643 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:47.528219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:47.529275 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:47.551425 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:47.552374 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:47.553952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:47.554921 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:47.556519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:47.558265 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:47.738609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:48.121980 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:48.133612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-db55cbe0-05d7-4470-8df8-1ad326d06868 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.661285 Aug 07 19:26:48.135338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 53/97] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:47 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:48.142608 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:48.154284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-30c3c092-dcff-42f0-86f2-408740caf907 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.635019 Aug 07 19:26:48.154873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 45/98] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:47 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:48.155316 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:48.156341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:48.163100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:48.163710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:48.164292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:48.165484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:48.166433 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:48.167259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:48.167414 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:48.175458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:48.182260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:48.183109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:48.183830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:48.184889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:48.185512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:48.186112 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:48.381317 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:48.393596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6422460b-5701-4bf8-ad98-aea3482a21c5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.256514 Aug 07 19:26:48.394467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 54/99] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:48 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:48.413717 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:48.421815 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-744f9fd8-a1d5-4989-89b1-af717235c0cd tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.264597 Aug 07 19:26:48.422717 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 46/100] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:48 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:49.155039 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:49.156268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:49.162706 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.163425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.163862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.164598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.165122 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.165535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.177792 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:49.178532 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:49.194647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.195136 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.195803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.196695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.197376 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.197788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.598910 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:49.609686 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2269f0a4-1822-43be-abf6-ffc51c76aedd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.458449 Aug 07 19:26:49.623109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:49.623109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3aaadec6-cb48-49b8-aced-9b78f51ca2fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.447965 Aug 07 19:26:49.625381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 55/101] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:49 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:49.635062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 47/102] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:49 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:49.635624 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:49.636314 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:49.640257 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:49.640870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:49.642925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.643603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.644246 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.645009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.645469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.645875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.649667 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.650167 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.650598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.651504 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:49.651940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:49.653789 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:49.852716 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:49.861364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4a7839ea-375c-4337-802d-04ebefe1a565 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.234671 Aug 07 19:26:49.862415 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 56/103] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:49 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:49.883111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:49.891792 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3f8d1732-538c-4630-9b20-68bbe3381b96 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.255408 Aug 07 19:26:49.892483 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 48/104] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:49 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:50.631806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:50.632707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:50.635394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:50.641526 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.642071 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.642546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:50.643261 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.643972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.644628 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:50.648392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:50.649322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:50.661014 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.661713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.662703 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:50.663458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.663923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.664517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:50.909918 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:50.910902 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:50.918783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d2b6216e-4d49-4c1c-a7ec-c9b8700068df tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.291817 Aug 07 19:26:50.919519 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 57/105] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:50 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:50.920256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-42d09c8a-3852-4739-955d-2b728acd6502 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.279189 Aug 07 19:26:50.921053 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 49/106] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:50 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:50.926882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:50.927861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:50.935640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.936822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.937465 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:50.938489 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:50.938824 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.939463 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:50.939589 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.940057 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:50.946780 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.947493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.948009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:50.948862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:50.949450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:50.950093 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:51.180889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:51.185396 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:51.192386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1c86a8c0-2bf9-429f-8af6-9edfb4997489 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.269782 Aug 07 19:26:51.194646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 50/107] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:50 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:51.210049 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-34945e22-fb2b-408c-8cd0-534c730b0407 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.289255 Aug 07 19:26:51.210774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 58/108] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:50 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:51.945190 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:51.946400 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:51.946897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:51.948555 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:51.957519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:51.958320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:51.959320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:51.960888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:51.961917 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:51.962251 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:51.962830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:51.963432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:51.964155 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:51.968573 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:51.969067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:51.969541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:52.241458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:52.244830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:52.249931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7d26a0f2-06e1-4343-bbc4-09d94e3ec6e9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.312813 Aug 07 19:26:52.258109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 51/109] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:51 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:52.258382 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-320baa50-8053-4e64-a03e-b218eb62ac69 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.312919 Aug 07 19:26:52.258458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:52.258458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:52.263137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:52.263778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:52.264238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:52.264924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:52.265375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:52.265791 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:52.266446 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 59/110] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:51 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:52.271254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:52.271867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:52.278130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:52.278859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:52.279301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:52.280011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:52.280605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:52.281193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:52.285777 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:52.496605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:52.501319 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:52.511721 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d2cf029b-3f7c-4528-8398-c00f3d2f22b4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.244148 Aug 07 19:26:52.512725 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 60/111] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:52 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:52.517000 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-23396d73-0218-4a32-89ae-7ce081d369c2 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.264173 Aug 07 19:26:52.517607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 52/112] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:52 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:53.271737 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:53.272373 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:53.274262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:53.275628 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:53.278575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.279058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.279494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.280226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.280669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.281098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.282226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.282966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.283600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.284540 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.285198 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.285805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.497614 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:53.501320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:53.505838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-43d2a6d0-2937-4ab3-9276-b23f3265e086 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.238796 Aug 07 19:26:53.506833 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 61/113] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:53 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:53.509473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ba74d7d9-7fc3-40f9-8d5c-cd7ada7e3298 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.240178 Aug 07 19:26:53.510230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 53/114] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:53 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:53.533162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:53.533684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:53.538779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:53.539383 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:53.541026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.541638 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.542072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.542939 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.543539 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.544179 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.546744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.547213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.548221 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.549105 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:53.549520 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:53.550725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:53.762528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:53.764922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:53.774041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-75225231-6cc3-406b-9467-c46238aa1e88 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.245043 Aug 07 19:26:53.774597 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3621a76a-71e8-421a-a93a-85dead74c8ac tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.239161 Aug 07 19:26:53.774787 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 54/115] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:53 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:53.775358 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 62/116] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:53 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:54.530493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:54.530493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:54.537694 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:54.538711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:54.540668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.541145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.541584 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:54.542265 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.542706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.543117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:54.546522 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.548905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.548905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:54.548905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.549540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.550055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:54.555655 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:54.772490 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:54.779706 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:54.786533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e0c889d3-0a3a-4403-8337-448497f576ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.260762 Aug 07 19:26:54.788275 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 55/117] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:54 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:54.793146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c2e2e23f-4a9a-4358-9176-d84f8b48c6e9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.260480 Aug 07 19:26:54.794299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 63/118] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:54 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:54.799865 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:54.800877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:54.807336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.807920 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.808495 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:54.809284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.809949 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.810669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:54.811914 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:54.812653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:54.819242 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.819743 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.820240 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:54.821089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:54.821573 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:54.822004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:55.037030 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:55.040517 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:55.046706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6ba4fef-3c56-4559-b069-eee67a83af19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.255481 Aug 07 19:26:55.048207 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 56/119] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:54 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:55.049240 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3c528cc8-f834-450c-b09e-448c5f811b5e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.253671 Aug 07 19:26:55.049815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 64/120] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:54 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:55.712898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-beb963fd-fb2c-4f6f-85a4-1861db0adeee req-0eea2ae2-93b7-43a0-8f4e-93dc4ad9514d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab31f7bc-2dfc-4b03-8e02-37f4ac156634", "name": "network-vif-plugged", "status": "completed", "tag": "ec5e8929-117c-45be-bbd1-05e5980f7c7a"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:55.723733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-beb963fd-fb2c-4f6f-85a4-1861db0adeee req-0eea2ae2-93b7-43a0-8f4e-93dc4ad9514d service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:55.724541 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-beb963fd-fb2c-4f6f-85a4-1861db0adeee req-0eea2ae2-93b7-43a0-8f4e-93dc4ad9514d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:55.725116 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-beb963fd-fb2c-4f6f-85a4-1861db0adeee req-0eea2ae2-93b7-43a0-8f4e-93dc4ad9514d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:55.738268 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-beb963fd-fb2c-4f6f-85a4-1861db0adeee req-0eea2ae2-93b7-43a0-8f4e-93dc4ad9514d service nova] Creating event network-vif-plugged:ec5e8929-117c-45be-bbd1-05e5980f7c7a for instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 on hv-cinder-85032 Aug 07 19:26:55.744229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-beb963fd-fb2c-4f6f-85a4-1861db0adeee req-0eea2ae2-93b7-43a0-8f4e-93dc4ad9514d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148571 Aug 07 19:26:55.744868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 57/121] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:55.823596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:55.825110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:55.825743 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:55.826476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:55.837828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:55.838062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:55.838336 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:55.838763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:55.839277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:55.839470 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:55.839940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:55.840348 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:55.840452 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:55.841426 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:55.842087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:55.842964 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:56.328425 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:56.331511 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:56.340551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e56c7822-b179-4067-8b70-fc89992ae040 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.524869 Aug 07 19:26:56.342181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6598894e-3c58-4232-9852-d63468408f59 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.526908 Aug 07 19:26:56.356331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 58/122] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:55 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:56.356331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:56.356331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:56.357044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 65/123] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:55 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:56.362504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:56.362716 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:56.363125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:56.363564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:56.364242 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:56.364413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:56.365155 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:56.365763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:56.372234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:56.373183 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:56.373874 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:56.375119 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:56.375786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:56.376540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:56.613475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:56.623158 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-95039ad4-629b-445b-8743-812769f0d4b5 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.272158 Aug 07 19:26:56.623752 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 59/124] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:56 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:56.639729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:56.647734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f0bb240b-1767-4aed-a12a-2020b17f57db tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.289365 Aug 07 19:26:56.648377 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 66/125] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:56 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:57.362234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:57.362842 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:57.370443 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:57.371695 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:57.376025 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.378405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.378888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.379312 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:57.380035 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.380644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.381104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:57.383585 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.384101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.384524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:57.388042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.391537 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:57.710220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:57.718970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cdb2a16e-44bc-4305-bc3c-e1eb954024f2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.352536 Aug 07 19:26:57.720886 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 67/126] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:57 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:57.725898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:57.728555 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:57.735009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.735487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.736270 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:57.747006 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.747486 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.747918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:57.796386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:57.806124 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-adf961c5-2e99-449b-b435-8f667ccd045d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1368 microversion: 2.1 time: 0.447552 Aug 07 19:26:57.807172 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 60/127] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:57 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:57.813006 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:57.814101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:57.821254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.821726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.822989 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:57.823929 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:57.824455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:57.824876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:58.144046 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:58.161665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:58.164947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0fbe33de-bab6-4008-bfe2-6120a4b8b9e7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.442751 Aug 07 19:26:58.165550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 68/128] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:57 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:58.170683 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-347d5e1b-a632-41d5-b161-b93770eaea0d tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.361919 Aug 07 19:26:58.176101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 61/129] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:57 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:26:58.188200 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acd4751-94cc-4386-8cfc-e47567370bae", "name": "network-vif-plugged", "status": "completed", "tag": "55fc6e17-2465-45a4-a50b-0bf3ff58fe40"}, {"server_uuid": "7e6588b5-4e24-43a6-a8d1-b40fdbe40a08", "name": "network-vif-plugged", "status": "completed", "tag": "734927af-232f-4ebf-acd0-0602c7c0911b"}, {"server_uuid": "280a2b69-299a-4b09-97df-07cc251437a7", "name": "network-vif-plugged", "status": "completed", "tag": "872ec0ba-2832-4ac2-8bfe-ef80b10fb5af"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:26:58.209677 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:58.210376 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:58.210911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:58.230580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] Creating event network-vif-plugged:55fc6e17-2465-45a4-a50b-0bf3ff58fe40 for instance 5acd4751-94cc-4386-8cfc-e47567370bae on hv-cinder-85032 Aug 07 19:26:58.231157 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] Creating event network-vif-plugged:734927af-232f-4ebf-acd0-0602c7c0911b for instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 on hv-cinder-85032 Aug 07 19:26:58.231742 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] Creating event network-vif-plugged:872ec0ba-2832-4ac2-8bfe-ef80b10fb5af for instance 280a2b69-299a-4b09-97df-07cc251437a7 on hv-cinder-85032 Aug 07 19:26:58.242018 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-2495601f-5ee4-4b81-af84-d3fa50c4c09a req-fc7a2c45-3159-4bd3-8d10-27ef757ff253 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.074941 Aug 07 19:26:58.242783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 69/130] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:26:58.759622 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:58.760965 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:58.767103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:58.767587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:58.768131 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:58.768869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:58.769333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:58.769751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:58.828799 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:58.829520 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:58.836020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:58.836531 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:58.836959 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:58.837659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:58.838113 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:58.838535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:59.029443 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:59.037954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f8f05456-3984-4e94-8709-f708bd41fe1f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.282589 Aug 07 19:26:59.038875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 62/131] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:58 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:59.066893 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:59.079826 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7f9fede3-2921-45a3-8d71-6d8487e9ec8f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1557 microversion: 2.1 time: 0.256530 Aug 07 19:26:59.082004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 70/132] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:58 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1557 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:26:59.105395 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:59.106424 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:59.136162 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:59.137938 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:59.139856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:59.156621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:59.157194 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:59.157678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:59.187475 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:59.188115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:59.203578 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:59.204475 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:59.206841 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:59.209677 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:59.210809 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:59.212988 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:59.630045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-198e58e2-e447-4766-9388-fb3c53c4165d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.530352 Aug 07 19:26:59.632365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 63/133] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:26:59 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-interface => generated 284 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:26:59.643801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:26:59.645598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:26:59.656399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:59.657774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:59.658295 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:59.659032 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:26:59.659475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:26:59.659926 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:26:59.974499 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:26:59.982823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1bb52d6d-0311-4cd2-bd7a-1cf6b4eaf8e3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.799750 Aug 07 19:26:59.996258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 71/134] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:59 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:00.062550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:00.063215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:00.069475 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:00.069953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:00.070379 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:00.071062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:00.071508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:00.071915 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:00.374160 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:00.384018 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d44382c-6946-43be-9752-9b823ee7b95b tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.749674 Aug 07 19:27:00.384762 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 64/135] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:26:59 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:00.396942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-adddc403-2141-4756-beef-278e6000af1d req-4a83a22f-8342-4a6b-bf73-87839e9a2022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7", "name": "network-vif-plugged", "status": "completed", "tag": "539ffdda-b91d-4657-ac08-52d85aa595d6"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:00.413025 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-adddc403-2141-4756-beef-278e6000af1d req-4a83a22f-8342-4a6b-bf73-87839e9a2022 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:00.413025 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-adddc403-2141-4756-beef-278e6000af1d req-4a83a22f-8342-4a6b-bf73-87839e9a2022 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:00.413381 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-adddc403-2141-4756-beef-278e6000af1d req-4a83a22f-8342-4a6b-bf73-87839e9a2022 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:00.425499 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-adddc403-2141-4756-beef-278e6000af1d req-4a83a22f-8342-4a6b-bf73-87839e9a2022 service nova] Creating event network-vif-plugged:539ffdda-b91d-4657-ac08-52d85aa595d6 for instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 on hv-cinder-85032 Aug 07 19:27:00.431416 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-adddc403-2141-4756-beef-278e6000af1d req-4a83a22f-8342-4a6b-bf73-87839e9a2022 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044797 Aug 07 19:27:00.432039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 65/136] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:27:00.481959 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:00.495444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6e956e92-edc3-4013-9e75-769fa0f3ab01 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.436621 Aug 07 19:27:00.496769 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 72/137] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:00 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:01.004391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:01.005149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:01.012495 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:01.013202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:01.013794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:01.014719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:01.015462 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:01.015890 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:01.281975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:01.293436 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-837b3939-a534-432a-945f-f5c6c7ff0135 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.294063 Aug 07 19:27:01.294243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 66/138] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:00 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:01.418686 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:01.419784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:01.428934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:01.430051 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:01.430796 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:01.432038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:01.432681 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:01.433485 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:01.517507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:01.518094 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:01.526266 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:01.527045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:01.527841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:01.528888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:01.529529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:01.530150 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:01.901859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:01.913767 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cd6ac043-abd4-4f69-b864-2b5b1f46ec04 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.400216 Aug 07 19:27:01.914875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 67/139] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:01 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:01.921488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1a476c6b-e01d-4149-b895-a7179bb3277d req-77151061-eb54-4bb4-80c8-5915f852197d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab31f7bc-2dfc-4b03-8e02-37f4ac156634", "tag": "ec5e8929-117c-45be-bbd1-05e5980f7c7a"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:01.922179 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:01.930726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0c3b19d4-6490-4ddc-b978-4b28b8b21758 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.517205 Aug 07 19:27:01.931866 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 73/140] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:01 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:01.944103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1a476c6b-e01d-4149-b895-a7179bb3277d req-77151061-eb54-4bb4-80c8-5915f852197d service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:01.944103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1a476c6b-e01d-4149-b895-a7179bb3277d req-77151061-eb54-4bb4-80c8-5915f852197d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:01.944103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1a476c6b-e01d-4149-b895-a7179bb3277d req-77151061-eb54-4bb4-80c8-5915f852197d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:01.948067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1a476c6b-e01d-4149-b895-a7179bb3277d req-77151061-eb54-4bb4-80c8-5915f852197d service nova] Creating event network-changed:ec5e8929-117c-45be-bbd1-05e5980f7c7a for instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 on hv-cinder-85032 Aug 07 19:27:01.953315 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1a476c6b-e01d-4149-b895-a7179bb3277d req-77151061-eb54-4bb4-80c8-5915f852197d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036136 Aug 07 19:27:01.954220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 68/141] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:27:02.322799 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:02.323514 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:02.330464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:02.331341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:02.331984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:02.332901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:02.333476 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:02.333955 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:02.509447 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:02.517277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-15d21b70-f3ce-4152-9767-4640d6cf7e2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.198738 Aug 07 19:27:02.530845 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 74/142] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:02 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:02.936176 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:02.937569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:02.940838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=84 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:02.952504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:02.953496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:02.960424 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:02.962946 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:02.964651 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:02.965381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:02.965803 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:02.966529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:02.966964 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:02.967375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:02.970510 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:02.971272 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:02.971741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:02.972188 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:03.263708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:03.274847 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ab67ad01-dda8-4541-a653-288a374a2e6a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.343427 Aug 07 19:27:03.288045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 69/143] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:02 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:03.324308 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:03.334310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-35fd5dd0-337a-4a42-83d4-8d76e118cef7 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.385549 Aug 07 19:27:03.348790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 75/144] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:02 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:03.538707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:03.539338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:03.546133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:03.546636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:03.547062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:03.548181 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:03.548628 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:03.549047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:03.686727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:03.694499 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-36f038b3-89d7-4b4b-b18c-218448b5dad7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.160064 Aug 07 19:27:03.695074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 70/145] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:03 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:04.299241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:04.299954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:04.306768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:04.307357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:04.307792 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:04.308588 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:04.309048 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:04.309469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:04.355547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:04.356285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:04.363257 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:04.363744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:04.364229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:04.365123 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:04.365359 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:04.365790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:04.395112 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:04.571210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:04.584881 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dbd6cdf9-2b0a-4f70-9bbc-8dd8054afef1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.290556 Aug 07 19:27:04.585467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 76/146] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:04 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:04.639802 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:04.650049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b4a7e97c-5eca-4d02-893a-9f6be9efd9b8 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1314 microversion: 2.1 time: 0.298258 Aug 07 19:27:04.650872 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 71/147] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:04 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:27:04.716528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:04.717144 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:04.723298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:04.724080 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:04.724706 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:04.725625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:04.726293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:04.726935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:04.898171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:04.906717 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1855bac6-4884-4a43-a1f4-182870a0b45d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1321 microversion: 2.1 time: 0.194105 Aug 07 19:27:04.907535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 77/148] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:04 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:05.605950 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:05.606581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:05.612837 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:05.613247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:05.613663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:05.614355 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:05.614800 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:05.615207 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:05.670965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:05.671688 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:05.678325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:05.678892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:05.679393 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:05.680184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:05.681003 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:05.681496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:05.791310 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:05.800021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e45023b5-a16c-4dbe-a571-89ea7389f034 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.197763 Aug 07 19:27:05.800694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 72/149] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:05 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:05.840454 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:05.848411 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a1728196-e690-449b-a13d-8556513d53e9 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1500 microversion: 2.1 time: 0.181457 Aug 07 19:27:05.848951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 78/150] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:05 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:05.927372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:05.928040 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:05.934213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:05.934681 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:05.935299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:05.935982 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:05.936422 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:05.937040 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:06.112535 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:06.121345 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-229c9dbb-d81b-4f93-b074-de4e027b10c7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1516 microversion: 2.1 time: 0.197682 Aug 07 19:27:06.121894 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 73/151] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:05 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:27:06.148267 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:06.150595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:06.168244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:06.168739 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:06.173147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:06.174154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:06.174804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:06.175400 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:06.250522 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lazy-loading 'flavor' on Instance uuid 280a2b69-299a-4b09-97df-07cc251437a7 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:27:06.317265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:06.378437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-415d7272-c703-43fe-a177-660e0a9d0d61 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7/action" status: 200 len: 32 microversion: 2.1 time: 0.237074 Aug 07 19:27:06.379269 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 79/152] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:27:06 2022] POST /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:27:06.389211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:06.390536 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:06.399050 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:06.399964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:06.400653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:06.401447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:06.402067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:06.402603 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:06.571733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:06.579646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5cb5f5be-afc0-4832-8146-a18a9bfca824 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.194959 Aug 07 19:27:06.580260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 74/153] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:06 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:06.821526 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:06.822327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:06.829009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:06.829678 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:06.830199 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:06.831038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:06.831558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:06.832056 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:07.002691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:07.012838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-74a29d87-836d-4e8d-9531-3ad1dd38df52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.195158 Aug 07 19:27:07.014355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 80/154] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:06 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:07.600397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:07.600940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:07.607275 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:07.607747 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:07.608207 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:07.608892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:07.609334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:07.609747 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:07.747882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:07.756212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-25295c6b-3ecb-4864-a9ce-79c35595acef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.159624 Aug 07 19:27:07.756959 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 75/155] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:07 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:08.035100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:08.036026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:08.042542 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:08.043361 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:08.043807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:08.044558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:08.045031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:08.045464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:08.234967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:08.243278 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d6f8e479-af80-4d9f-91de-bee9565d5150 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.212256 Aug 07 19:27:08.243872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 81/156] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:08 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:08.778975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:08.779530 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:08.785677 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:08.786383 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:08.787007 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:08.787700 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:08.788373 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:08.792353 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:08.989893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:09.008185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bde2c8db-0d51-4022-b6d0-b8194eb77c71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.227559 Aug 07 19:27:09.008185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 76/157] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:08 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:09.265744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:09.266347 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:09.268569 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=88 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:09.273814 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:09.274294 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:09.274725 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:09.275416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:09.276049 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:09.276659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:09.390497 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47742444-3d48-4968-a135-16d798cd8f00"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:09.393851 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:09.401258 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:09.402551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:09.403148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:09.404036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:09.404635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:09.405234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:09.438376 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:09.446647 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fdd02c29-d3d7-4570-8734-7d91623bd12b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.185435 Aug 07 19:27:09.447575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 82/158] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:09 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:10.023016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:10.023603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:10.030102 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:10.030777 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:10.031204 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:10.032138 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:10.032711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:10.033137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:10.197880 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:10.207210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a63c5ba-a7c6-48cb-9a53-571f700c4d19 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.187908 Aug 07 19:27:10.208093 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 83/159] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:10 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:10.468645 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:10.469338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:10.475585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:10.476331 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:10.476736 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:10.477790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:10.478362 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:10.478774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:10.613698 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:10.621738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f6090130-d2df-4ba0-b815-6e0fb29bcf61 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.158397 Aug 07 19:27:10.622399 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 84/160] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:10 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:27:11.228442 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:11.229064 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:11.235244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:11.235804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:11.236258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:11.236941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:11.237397 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:11.237810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:11.373763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:11.381459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b993cf10-7950-4be6-822a-87a5fd756b9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.156954 Aug 07 19:27:11.382019 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 85/161] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:11 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:11.642565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:11.643188 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:11.649424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:11.649889 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:11.650317 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:11.650997 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:11.651455 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:11.651857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:11.785190 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:11.794290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-020e5538-1f27-4afc-9ca3-a9727a5fd3d0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.155391 Aug 07 19:27:11.794981 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 86/162] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:11 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:27:12.401905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:12.402516 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:12.409660 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:12.410147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:12.410575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:12.414727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:12.414727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:12.414727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:12.558546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:12.566984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1e1b8bde-b969-4eb6-b3dd-114c7b483d8d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.169086 Aug 07 19:27:12.567722 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 87/163] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:12 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:27:12.817972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:12.818600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:12.825189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:12.825762 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:12.826234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:12.826953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:12.827347 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:12.827802 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:12.977209 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:12.986419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4fbddfca-4ebc-4934-945f-22a5de52ac06 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1362 microversion: 2.1 time: 0.172328 Aug 07 19:27:12.987290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 88/164] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:12 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:13.413779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f2c135f9-e768-467d-9bb2-4a0f630aad9e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "POST /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.026625 Aug 07 19:27:13.415300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 77/165] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:27:09 2022] POST /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08/os-volume_attachments => generated 194 bytes in 4030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:27:13.589289 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:13.590212 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:13.596533 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:13.597224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:13.597662 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:13.598364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:13.598829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:13.599225 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:13.756894 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:13.766170 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0f87974d-eaa1-41da-bef0-f0e3abdec0c0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.181740 Aug 07 19:27:13.767293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 89/166] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:13 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:14.013215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:14.013911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:14.020823 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:14.021648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:14.022171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:14.023645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:14.024355 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:14.024982 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:14.202738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:14.211486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-98fc4ca4-75ae-4d78-b13a-a12d52f8c53a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1548 microversion: 2.1 time: 0.203063 Aug 07 19:27:14.212086 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 78/167] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:14 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:14.233645 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:14.234318 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:14.241361 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:14.241732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:14.242622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:14.243693 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:14.244327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:14.244998 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:14.328855 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f814db1-f447-4348-8368-b5c6d0d9db4c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099074 Aug 07 19:27:14.329645 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 90/168] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:27:14 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:27:14.796235 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:14.798816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:14.812577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:14.813436 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:14.814307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:14.815285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:14.815947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:14.816693 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:15.123481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:15.137905 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7eedb189-0c0e-41bb-ad29-8747218b5160 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.347141 Aug 07 19:27:15.154533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 79/169] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:14 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:15.943171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-5dcc5519-7fb2-4c34-a5c3-d7d06222bd99 req-357eda78-f741-4453-9d50-53b7ffa57703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7", "tag": "539ffdda-b91d-4657-ac08-52d85aa595d6"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:15.955191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-5dcc5519-7fb2-4c34-a5c3-d7d06222bd99 req-357eda78-f741-4453-9d50-53b7ffa57703 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:15.955941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-5dcc5519-7fb2-4c34-a5c3-d7d06222bd99 req-357eda78-f741-4453-9d50-53b7ffa57703 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:15.956557 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-5dcc5519-7fb2-4c34-a5c3-d7d06222bd99 req-357eda78-f741-4453-9d50-53b7ffa57703 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:15.969185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-5dcc5519-7fb2-4c34-a5c3-d7d06222bd99 req-357eda78-f741-4453-9d50-53b7ffa57703 service nova] Creating event network-changed:539ffdda-b91d-4657-ac08-52d85aa595d6 for instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 on hv-cinder-85032 Aug 07 19:27:15.976047 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-5dcc5519-7fb2-4c34-a5c3-d7d06222bd99 req-357eda78-f741-4453-9d50-53b7ffa57703 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037198 Aug 07 19:27:15.977108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 91/170] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:27:16.162555 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:16.165148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:16.185075 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:16.185892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:16.186523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:16.187447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:16.188127 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:16.188896 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:16.577099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:16.587060 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a3108973-bc55-400e-a54b-c7b60ae0f7e9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.429554 Aug 07 19:27:16.588473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 80/171] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:16 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:27:17.613377 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:17.614204 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:17.620761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:17.621343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:17.621792 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:17.622665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:17.623320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:17.623785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:17.789772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:17.798035 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-27c41339-1626-460b-b039-79f26a4a848f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.188888 Aug 07 19:27:17.798605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 92/172] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:17 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:18.823723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:18.824330 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:18.832473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:18.833197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:18.833846 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:18.834933 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:18.835672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:18.836360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:18.973569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:18.984425 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4f30bc5a-6f1b-4de5-84ba-4defc729eb3e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.167113 Aug 07 19:27:18.985604 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 81/173] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:18 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:20.009712 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:20.010354 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:20.017373 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:20.017912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:20.018323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:20.019048 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:20.019498 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:20.019921 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:20.152882 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:20.160687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8052ec71-30f9-48be-b897-5e8df4e1978a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.154854 Aug 07 19:27:20.161257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 93/174] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:20 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:21.182588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:21.183474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:21.193587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:21.194233 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:21.194866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:21.195940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:21.196659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:21.197303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:21.345515 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:21.353410 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a5c9170-cb0b-463b-97c9-a25c3541785d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.174960 Aug 07 19:27:21.354012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 82/175] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:21 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:22.379107 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:22.379705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:22.386095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:22.386635 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:22.386987 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:22.387684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:22.388175 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:22.388597 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:22.525369 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:22.533242 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cf68c5d7-6001-424c-905b-d778e6b3083d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.157974 Aug 07 19:27:22.533819 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 94/176] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:22 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:23.554671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:23.555230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:23.562222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:23.562709 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:23.563140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:23.563919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:23.564417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:23.564839 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:23.701278 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:23.709393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9d3e75c5-1a67-4fa2-9691-6b7b4924f2e2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.158685 Aug 07 19:27:23.709946 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 83/177] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:23 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:24.730156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:24.730781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:24.737408 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:24.737893 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:24.738336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:24.738990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:24.739430 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:24.739839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:24.874632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:24.882740 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-07fa1a62-db2b-4507-9099-d3d8963e8990 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.156408 Aug 07 19:27:24.883393 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 95/178] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:24 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:25.904069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:25.904694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:25.911766 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:25.912287 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:25.912722 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:25.913410 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:25.913865 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:25.914346 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:26.053879 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:26.062175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d7fd61e-c2f3-493f-98d3-7fad801a6067 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.162081 Aug 07 19:27:26.062764 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 84/179] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:25 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:27.083356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:27.083918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:27.090401 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:27.090876 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:27.091305 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:27.092014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:27.092482 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:27.092911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:27.097213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:27.232301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:27.240304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3242caab-d160-48d4-b5c5-121e350ee07a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.160929 Aug 07 19:27:27.240875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 96/180] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:27 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:28.261015 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:28.261648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:28.268537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:28.269007 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:28.269433 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:28.270161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:28.270611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:28.271024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:28.403885 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:28.412594 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45ac0586-3db4-47b1-a1e0-0ca04873d5f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.155292 Aug 07 19:27:28.413238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 85/181] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:28 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:29.434990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:29.435737 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:29.442507 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:29.442990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:29.443429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:29.444206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:29.444661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:29.445091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:29.581958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:29.590523 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3fdc00e2-8ecf-4ee9-8b4a-21797dfa9af0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.159987 Aug 07 19:27:29.591186 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 97/182] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:29 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:29.888632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:29.889126 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:29.895855 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:29.896554 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:29.896797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:29.897481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:29.897920 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:29.898329 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:29.928027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:27:29.933399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:30.032186 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ba44b91a-1cfc-4fb7-987a-b6678fcdb601 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 204 len: 0 microversion: 2.1 time: 0.147148 Aug 07 19:27:30.032985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 86/183] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:27:29 2022] DELETE /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:27:30.041317 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:30.041926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:30.048934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:30.049419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:30.049876 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:30.050604 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:30.051154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:30.051608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:30.194227 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:30.202662 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-090a879a-a949-409f-930b-7a21a9f61bbe tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1552 microversion: 2.1 time: 0.165179 Aug 07 19:27:30.228271 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 98/184] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:30 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:30.612512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:30.613214 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:30.619751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:30.620276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:30.620714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:30.621413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:30.621863 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:30.622290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:30.755944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:30.763713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-209c8c01-fb08-4a35-8a19-5d953013c72f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.155507 Aug 07 19:27:30.764324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 87/185] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:30 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:31.237383 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:31.237989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:31.244318 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:31.244787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:31.245373 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:31.246461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:31.247222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:31.247943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:31.385625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:31.394014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-250ae4a2-4bed-4f82-82b3-64f70296746c tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1552 microversion: 2.1 time: 0.160520 Aug 07 19:27:31.394590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 99/186] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:31 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:31.785784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:31.786369 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:31.793341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:31.793870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:31.794337 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:31.795033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:31.795491 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:31.795949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:31.937071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:31.944932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-893d81e5-3fce-4dea-a231-56b59a6641f9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.163157 Aug 07 19:27:31.945521 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 88/187] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:31 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:32.415781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:32.416722 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:32.424416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:32.424927 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:32.425356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:32.426052 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:32.426510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:32.426903 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:32.571069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:32.579526 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-57668924-dbe5-4f25-bbf9-ac9616f67c04 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1552 microversion: 2.1 time: 0.167654 Aug 07 19:27:32.580130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 100/188] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:32 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:32.966235 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:32.967299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:32.974593 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:32.975129 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:32.975551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:32.976303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:32.976761 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:32.977193 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:33.122647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:33.130575 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-704d400a-05ab-404c-a796-5eac9bf4fb91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.168534 Aug 07 19:27:33.131412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 89/189] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:32 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:33.599980 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:33.601506 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:33.608032 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:33.608672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:33.609203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:33.610018 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:33.610490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:33.611392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:33.771539 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:33.784014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-568136cb-ab6b-4d92-9106-d60e490fa9f1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1552 microversion: 2.1 time: 0.187818 Aug 07 19:27:33.784612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 101/190] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:33 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:34.154731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:34.155977 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:34.159973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:34.165302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:34.165985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:34.166573 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:34.167598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:34.168217 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:34.168901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:34.303291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:34.311069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f77e35a8-33c4-4a32-ac36-b66d8615e85d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.161260 Aug 07 19:27:34.311672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 90/191] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:34 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:34.810968 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:34.812052 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:34.825144 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:34.826226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:34.827014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:34.828290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:34.829083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:34.829807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:35.039952 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:35.049384 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-08d10246-12f4-4aa6-a7cc-333b5cec8094 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1552 microversion: 2.1 time: 0.247043 Aug 07 19:27:35.050686 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 102/192] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:34 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:35.336034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:35.337887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:35.352961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:35.354893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:35.355915 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:35.357035 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:35.358085 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:35.358750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:35.575759 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:35.586975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2a90e2cc-7787-4133-af6e-12a468126079 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.258032 Aug 07 19:27:35.587672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 91/193] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:35 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:35.612674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-a4984a75-c590-4a81-b9e9-bd1aa554b672 req-e147c5db-bd9d-4c25-aab4-6866f1834f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e6588b5-4e24-43a6-a8d1-b40fdbe40a08", "name": "network-vif-deleted", "tag": "734927af-232f-4ebf-acd0-0602c7c0911b"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:35.648719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-a4984a75-c590-4a81-b9e9-bd1aa554b672 req-e147c5db-bd9d-4c25-aab4-6866f1834f35 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:35.649513 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-a4984a75-c590-4a81-b9e9-bd1aa554b672 req-e147c5db-bd9d-4c25-aab4-6866f1834f35 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:35.649977 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-a4984a75-c590-4a81-b9e9-bd1aa554b672 req-e147c5db-bd9d-4c25-aab4-6866f1834f35 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:35.665104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-a4984a75-c590-4a81-b9e9-bd1aa554b672 req-e147c5db-bd9d-4c25-aab4-6866f1834f35 service nova] Creating event network-vif-deleted:734927af-232f-4ebf-acd0-0602c7c0911b for instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 on hv-cinder-85032 Aug 07 19:27:35.670839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-a4984a75-c590-4a81-b9e9-bd1aa554b672 req-e147c5db-bd9d-4c25-aab4-6866f1834f35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062135 Aug 07 19:27:35.671514 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 103/194] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:27:36.074960 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:36.075897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:36.083015 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:36.083496 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:36.084184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:36.085378 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:36.085617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:36.086199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:36.166768 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce40a75512a4ff9971552ffc54136c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd300969a86954ad7ab74b743e72bcaf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:36.176351 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-39f642e6-2e0e-4f7e-97d9-e108ed44bf6f tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 200 len: 1345 microversion: 2.1 time: 0.106732 Aug 07 19:27:36.177229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 92/195] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:36 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 1345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:36.618267 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:36.620599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:36.627166 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:36.627654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:36.628122 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:36.628827 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:36.629277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:36.630195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:36.812626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:36.825375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5387b47e-9c78-4948-92f5-9671fad3fc71 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.211762 Aug 07 19:27:36.826233 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 104/196] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:36 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:37.198951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:37.199892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:37.209143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:37.209679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:37.210544 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:37.211380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:37.211970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:37.212489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:37.234879 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] HTTP exception thrown: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Request method failure captured: Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 HTTP/1.1 Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHSvFnriEH6cfr9LW_iSHoXhnLaMr_6y3PqWKfL6ie-yH3DcawvX46SOfIiCPJWEnDooaIvtHrx2utepYbRvu00vFZ-oYoz9L0uX4Mmmpt3qT5NypYvN2k_uhekB6zxnDI3cJagqyPrAYl1PRjEli8UitfIaxSbnBbXK8GzMh6_-ns Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:27:37.240756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d300969a86954ad7ab74b743e72bcaf1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 5ce40a75512a4ff9971552ffc54136c3 Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.242302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '7e6588b5-4e24-43a6-a8d1-b40fdbe40a08'} Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:27:37.243229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.244689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.247082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Returning 404 to user: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:27:37.247082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60612ba8-6497-413d-82d8-5bd95dfc30e1 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 404 len: 111 microversion: 2.1 time: 0.047548 Aug 07 19:27:37.247082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 93/197] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:37 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:27:37.372297 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:37.374735 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:37.381127 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:37.381724 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:37.382163 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:37.382854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:37.383532 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:37.383704 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:37.397521 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] HTTP exception thrown: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Request method failure captured: Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08/os-volume_attachments HTTP/1.1 Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHSvFnriEH6cfr9LW_iSHoXhnLaMr_6y3PqWKfL6ie-yH3DcawvX46SOfIiCPJWEnDooaIvtHrx2utepYbRvu00vFZ-oYoz9L0uX4Mmmpt3qT5NypYvN2k_uhekB6zxnDI3cJagqyPrAYl1PRjEli8UitfIaxSbnBbXK8GzMh6_-ns Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:27:37.401781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d300969a86954ad7ab74b743e72bcaf1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 5ce40a75512a4ff9971552ffc54136c3 Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.403515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '7e6588b5-4e24-43a6-a8d1-b40fdbe40a08'} Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:27:37.404492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:37.405862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:37.407390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Returning 404 to user: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:27:37.407390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6e771ca3-ac6c-4a37-9371-4451ba73bb62 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035149 Aug 07 19:27:37.407390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 105/198] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:27:37 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:27:37.846285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:37.846924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:37.853145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:37.853633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:37.854069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:37.854770 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:37.855219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:37.855636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:38.030098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:38.039493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-98b3ae6e-72dc-4c07-9bb8-51045a769288 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.197105 Aug 07 19:27:38.040006 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 94/199] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:37 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:38.677535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:38.678639 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:38.688030 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:38.688799 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:38.689355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:38.690159 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:38.690744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:38.691481 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:38.709903 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] HTTP exception thrown: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Request method failure captured: Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 HTTP/1.1 Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHSvFnriEH6cfr9LW_iSHoXhnLaMr_6y3PqWKfL6ie-yH3DcawvX46SOfIiCPJWEnDooaIvtHrx2utepYbRvu00vFZ-oYoz9L0uX4Mmmpt3qT5NypYvN2k_uhekB6zxnDI3cJagqyPrAYl1PRjEli8UitfIaxSbnBbXK8GzMh6_-ns Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:27:38.713457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d300969a86954ad7ab74b743e72bcaf1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 5ce40a75512a4ff9971552ffc54136c3 Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.714929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '7e6588b5-4e24-43a6-a8d1-b40fdbe40a08'} Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:27:38.715705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.717002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.720372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Returning 404 to user: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:27:38.721713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-de32dd4a-e044-4887-ac4c-6f95ad2339a0 tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 404 len: 111 microversion: 2.1 time: 0.048784 Aug 07 19:27:38.722656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 106/200] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:27:38 2022] DELETE /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:27:38.737936 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:38.738626 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] [instance: 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:38.746032 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:38.746947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:38.747407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:38.748372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:38.750173 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:38.750654 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:38.768659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] HTTP exception thrown: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Request method failure captured: Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 HTTP/1.1 Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHSvFnriEH6cfr9LW_iSHoXhnLaMr_6y3PqWKfL6ie-yH3DcawvX46SOfIiCPJWEnDooaIvtHrx2utepYbRvu00vFZ-oYoz9L0uX4Mmmpt3qT5NypYvN2k_uhekB6zxnDI3cJagqyPrAYl1PRjEli8UitfIaxSbnBbXK8GzMh6_-ns Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:27:38.770199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d300969a86954ad7ab74b743e72bcaf1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d300969a86954ad7ab74b743e72bcaf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d300969a86954ad7ab74b743e72bcaf1 Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055202673 Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 5ce40a75512a4ff9971552ffc54136c3 Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-DeleteServersTestJSON-2055202673-project Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.771740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '7e6588b5-4e24-43a6-a8d1-b40fdbe40a08'} Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:27:38.772484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. Aug 07 19:27:38.773906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:27:38.775051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] Returning 404 to user: Instance 7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:27:38.775051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4a5ac222-9d10-436d-ad81-dd1ea59db03e tempest-DeleteServersTestJSON-2055202673 tempest-DeleteServersTestJSON-2055202673-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08" status: 404 len: 111 microversion: 2.1 time: 0.039118 Aug 07 19:27:38.775051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 95/201] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:38 2022] GET /compute/v2.1/servers/7e6588b5-4e24-43a6-a8d1-b40fdbe40a08 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:27:39.063298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:39.064234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:39.074699 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:39.075202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:39.075668 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:39.078647 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:39.080307 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:39.080751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:39.318751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:39.327134 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-81a7b081-bfc5-45b9-abf3-86334a48d53c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.268395 Aug 07 19:27:39.327755 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 107/202] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:39 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:40.350140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:40.351399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:40.361201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:40.361937 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:40.362555 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:40.363428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:40.364045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:40.364606 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:40.635032 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:40.646849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3edff906-f2e9-4738-9bb6-5eac84d7d595 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.301934 Aug 07 19:27:40.647941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 96/203] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:40 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:41.669979 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:41.670672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:41.678723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=52 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:41.701952 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:41.715197 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:41.716344 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:41.719115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:41.726299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:41.727077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:42.023983 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:42.036030 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7e671a3a-e0d1-434f-87df-2da7a39b62cd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.370618 Aug 07 19:27:42.036912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 108/204] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:41 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:43.074278 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:43.075051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:43.088622 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:43.090560 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:43.091403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:43.093061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:43.093784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:43.094633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:43.371334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:43.380385 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ee940e34-ac5f-41f2-8bca-0c4ae2ef152e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.323833 Aug 07 19:27:43.380864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 97/205] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:43 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:44.403569 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:44.404913 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:44.425183 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:44.426182 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:44.426699 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:44.427776 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:44.428324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:44.428937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:44.678140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:44.692530 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47ae5bfa-eaa9-4d0d-b8c2-f20f3297e2a6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.293471 Aug 07 19:27:44.695520 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 109/206] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:44 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:45.714692 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:45.716142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:45.724245 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:45.725007 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:45.726326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:45.727338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:45.728038 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:45.728618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:45.923752 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:45.933528 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-05584656-1c63-4f00-a368-4b4a5e5a0b99 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.222576 Aug 07 19:27:45.934979 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 98/207] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:45 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:46.958985 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:46.959612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:46.971016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:46.971624 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:46.972260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:46.973077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:46.973634 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:46.974220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:47.184482 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:47.196394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d6523357-f6d9-4c52-ba9e-d0ddd5f069fd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.241218 Aug 07 19:27:47.197837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 110/208] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:46 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:48.226882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:48.228517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:48.235761 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:48.236633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:48.248213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:48.249512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:48.250406 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:48.251140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:48.663049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:48.677021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f9f693ee-69ba-4b37-908e-39863293e365 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.458867 Aug 07 19:27:48.681397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 99/209] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:48 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:49.703420 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:49.706262 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:49.718511 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:49.719825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:49.720958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:49.722525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:49.723638 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:49.724734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:50.036412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:50.054097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fa27274e-859e-4a82-ad6b-3d3d1dd78fc9 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.357836 Aug 07 19:27:50.055527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 111/210] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:49 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:51.077396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:51.078066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:51.089869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:51.091008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:51.091721 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:51.092708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:51.093424 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:51.094066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:51.364824 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:51.376610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e0a700db-6b73-4a78-82ab-aa741c9c1e57 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.304800 Aug 07 19:27:51.377208 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 100/211] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:51 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:52.397252 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:52.397919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:52.406641 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:52.408603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:52.420586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:52.421642 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:52.422727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:52.423327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:52.713677 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:52.725970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-496b2dfc-8c56-405e-85a6-9f143c04d085 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.332749 Aug 07 19:27:52.731417 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 112/212] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:52 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:27:53.754648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:53.755562 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:53.769754 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:53.770565 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:53.772791 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:53.777935 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:53.779086 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:53.779969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:54.149860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:54.163609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d1bb452-cd6c-4b3e-8065-8dea0d9c1df7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1522 microversion: 2.1 time: 0.412504 Aug 07 19:27:54.165054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 101/213] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:53 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:55.187429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:55.188258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:55.210964 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:55.211652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:55.212125 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:55.213094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:55.213700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:55.216154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:56.116591 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:56.139336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eaf47a34-9ab3-4f71-a2bd-a3a7ca976713 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1502 microversion: 2.1 time: 0.952496 Aug 07 19:27:56.141531 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 113/214] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:55 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1502 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:56.163071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:56.163691 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:56.173816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:56.174971 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:56.175953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:56.178859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:56.179857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:56.181067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:56.914304 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:56.948816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8be716db-0060-4d03-8c89-8d5ca6de105b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1516 microversion: 2.1 time: 0.790451 Aug 07 19:27:56.975568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 102/215] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:56 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1516 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:27:57.733215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3ed22f68-7f43-4332-b139-3e27b2e213c7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Action: 'create', calling method: .version_select at 0x7fd476f689d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1815908904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY4Y5s3xUG7K7t8T3hq2dn8ONSzmZQY5FgeCOudriEE8YXxi1CwFC5NLqi68V5iqFWplc2i5iVDsWl+Ca89TEByhsmPqELawL0daB2iMyd7pwz2LuZ0XMZr8bUV0GvyAQ=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:57.775913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3ed22f68-7f43-4332-b139-3e27b2e213c7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Getting quotas for project 6e5e8fba8d65419393ba9829cafdd5b9. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:27:57.782437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3ed22f68-7f43-4332-b139-3e27b2e213c7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Getting quotas for user dbec912e4d5c4c6aabed5a98b6aa632d and project 6e5e8fba8d65419393ba9829cafdd5b9. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:27:57.815475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3ed22f68-7f43-4332-b139-3e27b2e213c7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.547360 Aug 07 19:27:57.816864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 103/216] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:27:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:27:57.926509 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d09aaa9a-d2e2-4f81-8b85-9f78f7cb2d28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'create', calling method: .version_select at 0x7fd477693670>, body: {"keypair": {"name": "tempest-keypair-442231156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFQ0su/Tyj2+JDYbZ9bMM1vfFRw4MrsaLpe8KzreIyKEzTfac6zwKSPEP1YGmQF/A3HC4ElRR3f3xrYHJFT/4slmZ13RVodYut8+fyB8f5UwPifhaERJMV+uWSNfHKtjQ=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:57.985622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-d09aaa9a-d2e2-4f81-8b85-9f78f7cb2d28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for project d12435b63a424deeb1cca3ba959245a4. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:27:57.992716 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-d09aaa9a-d2e2-4f81-8b85-9f78f7cb2d28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for user bb092d77de334d3ab631a42979460c59 and project d12435b63a424deeb1cca3ba959245a4. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:27:58.079391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d09aaa9a-d2e2-4f81-8b85-9f78f7cb2d28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.966737 Aug 07 19:27:58.081106 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 114/217] 10.222.0.17 () {62 vars in 1200 bytes} [Sun Aug 7 19:27:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 972 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 19:27:58.629170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:27:58.637600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:58.671092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:58.676904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:58.678405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:58.682305 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:58.683096 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:58.683769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:58.693338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:58.743264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lazy-loading 'flavor' on Instance uuid 5acd4751-94cc-4386-8cfc-e47567370bae {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:27:58.975362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-236f2bf5-e851-4fdc-be03-bcb2931b67ef tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae/action" status: 200 len: 32 microversion: 2.1 time: 0.349795 Aug 07 19:27:58.982069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 104/218] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:27:58 2022] POST /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:27:58.997413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:27:58.998261 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:27:59.024854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:59.026301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:59.028244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:59.032690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:27:59.033174 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:27:59.033609 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:27:59.037828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=95 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:59.531927 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:27:59.556656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9bf7c07c-b394-412a-8976-713bf9e53638 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.572383 Aug 07 19:27:59.569764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 115/219] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:27:58 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:00.612611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:00.613339 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:00.634290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:00.634969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:00.635435 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:00.639413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:00.641914 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:00.643447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:01.133672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1733984961", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f692703-83bb-47e7-bf30-c4b2cfe265b0"}], "security_groups": [{"name": "tempest-securitygroup--623238956"}], "key_name": "tempest-keypair-442231156", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:01.567866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:01.583016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d0e3a51-788d-4044-95fa-29544cdfd44f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.972717 Aug 07 19:28:01.583792 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 105/220] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:00 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:01.619534 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] validate_networks() for [('9f692703-83bb-47e7-bf30-c4b2cfe265b0', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:28:02.513139 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:28:02.514486 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:28:02.515277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:28:02.516674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:28:02.517431 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:28:02.532543 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:02.533371 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:02.534100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:02.535222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:02.552175 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:02.553598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:02.612748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for project d12435b63a424deeb1cca3ba959245a4. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:28:02.614164 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:02.614967 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:02.623868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for user bb092d77de334d3ab631a42979460c59 and project d12435b63a424deeb1cca3ba959245a4. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:28:02.628891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:02.631423 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:02.632414 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:02.634866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:02.635627 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:02.637831 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:02.663440 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:28:02.669516 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:28:02.790852 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f8ff349-58a5-445d-a503-31dfaa234f5f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.659755 Aug 07 19:28:02.798440 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 116/221] 10.222.0.17 () {62 vars in 1188 bytes} [Sun Aug 7 19:28:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 07 19:28:02.807320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4b06ac55-41d6-4215-93a4-6f2fa78c3b31 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:02.810963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4b06ac55-41d6-4215-93a4-6f2fa78c3b31 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:02.919224 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:02.935845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ec34077-5bbb-48ac-8887-84f67dfe3cac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.326426 Aug 07 19:28:02.946219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 106/222] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:02 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:02.973710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4b06ac55-41d6-4215-93a4-6f2fa78c3b31 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:02.983537 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4b06ac55-41d6-4215-93a4-6f2fa78c3b31 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:02.986213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4b06ac55-41d6-4215-93a4-6f2fa78c3b31 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:02.987820 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4b06ac55-41d6-4215-93a4-6f2fa78c3b31 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1281 microversion: 2.20 time: 0.188302 Aug 07 19:28:03.004092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 117/223] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:02 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:03.967702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:03.969006 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:03.983054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:03.983465 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:03.986659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:03.987867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:03.988517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:03.990097 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:04.014146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:04.016243 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:04.041110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:04.042227 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:04.044013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:04.045018 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:04.046304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:04.047769 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:04.342326 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:04.356719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:04.359437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:04.360954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d73b155a-5ee9-41fb-a2b3-08f196059a53 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1277 microversion: 2.20 time: 0.353180 Aug 07 19:28:04.365094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 118/224] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:04 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1277 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:04.395457 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:04.405115 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b304ea26-1793-4961-b8fb-da2ae85351dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.441641 Aug 07 19:28:04.406073 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 107/225] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:03 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:05.389786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:05.390447 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:05.396820 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:05.397304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:05.397726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:05.398404 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:05.398861 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:05.399277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:05.431291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:05.431904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:05.434396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:05.440161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:05.440668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:05.441106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:05.441812 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:05.442266 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:05.442683 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:05.465734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:05.474292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:05.475905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:05.477061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ed0256eb-fa8e-495b-8d25-9d056d6489e5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1333 microversion: 2.20 time: 0.091408 Aug 07 19:28:05.477636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 119/226] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:05 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:05.576493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:05.589995 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-828cbbf4-cc8e-4ccc-ae7d-b003b4686ae3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.162709 Aug 07 19:28:05.590614 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 108/227] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:05 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:06.500022 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:06.500625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:06.507085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:06.507572 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:06.507976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:06.508731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:06.509156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:06.509604 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:06.584862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:06.596014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:06.597568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:06.598656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eb7fdedc-1437-4ea6-a17a-f324b2a8cedc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1333 microversion: 2.20 time: 0.102853 Aug 07 19:28:06.599213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 120/228] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:06 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:06.610997 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:06.611833 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:06.621901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:06.622384 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:06.622822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:06.623654 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:06.624166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:06.624653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:06.756149 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:06.756534 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:06.761953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:06.762792 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:06.763298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:06.763720 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:06.764462 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:06.764917 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:06.765336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:06.770796 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8e94b1e9-2b14-420f-8ffe-090ac2be6bcb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.163711 Aug 07 19:28:06.771560 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 109/229] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:06 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:06.792254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-12c04499-2566-477b-b2ff-2fedc586838f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/ips" status: 200 len: 149 microversion: 2.1 time: 0.040140 Aug 07 19:28:06.792826 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 121/230] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:28:06 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:07.622155 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:07.623419 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:07.630317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:07.631139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:07.631815 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:07.632765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:07.633432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:07.634070 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:07.730908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:07.740228 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:07.742266 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:07.744473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-40ace26c-7e76-4568-a4ef-d5e584a62370 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1339 microversion: 2.20 time: 0.126075 Aug 07 19:28:07.760610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 110/231] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:07 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1339 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:28:07.793230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:07.793943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:07.802328 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:07.803236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:07.803969 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:07.805393 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:07.806235 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:07.807072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:08.013350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:08.025563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6a13d902-c415-463f-9b0a-e92c68cc2099 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.236275 Aug 07 19:28:08.026470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 122/232] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:07 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:08.223770 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d97db7b-0978-4e0c-b89d-876901a5fcd0"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:08.227350 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:08.227909 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:08.240069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:08.241210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:08.241840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:08.242864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:08.244809 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:08.246475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:08.703024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6bd79bda-788e-4516-ac85-6e16cb2a6330 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483535 Aug 07 19:28:08.704280 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 111/233] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:28:08 2022] POST /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:08.768086 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:08.768763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:08.775621 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:08.776356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:08.776785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:08.777489 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:08.777934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:08.778351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:08.861672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-a7f9157a-a4e8-45c6-8aa7-c053ed81b54a req-6f1d737f-bfa2-44e8-ae8b-3ccce4097d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20345500-7cc0-4cd4-9c7a-35fc42ba4a32", "tag": "a274bf48-e334-42be-b1f2-d9db7f626a04"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:08.872454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-a7f9157a-a4e8-45c6-8aa7-c053ed81b54a req-6f1d737f-bfa2-44e8-ae8b-3ccce4097d8f service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:08.873034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-a7f9157a-a4e8-45c6-8aa7-c053ed81b54a req-6f1d737f-bfa2-44e8-ae8b-3ccce4097d8f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:08.873656 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-a7f9157a-a4e8-45c6-8aa7-c053ed81b54a req-6f1d737f-bfa2-44e8-ae8b-3ccce4097d8f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:08.894996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-a7f9157a-a4e8-45c6-8aa7-c053ed81b54a req-6f1d737f-bfa2-44e8-ae8b-3ccce4097d8f service nova] Creating event network-changed:a274bf48-e334-42be-b1f2-d9db7f626a04 for instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 on hv-cinder-85032 Aug 07 19:28:08.900501 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-a7f9157a-a4e8-45c6-8aa7-c053ed81b54a req-6f1d737f-bfa2-44e8-ae8b-3ccce4097d8f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043857 Aug 07 19:28:08.901274 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 112/234] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:08.950199 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:08.958620 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:08.960846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:08.961994 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3456fbdb-0866-4252-abaa-06ef0cd08d40 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.198973 Aug 07 19:28:08.962564 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 123/235] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:08 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:09.048270 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:09.048516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:09.056618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:09.057197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:09.057772 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:09.058426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:09.058884 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:09.059316 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:09.205324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:09.213746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0ec8a8c5-7d4d-40c6-a230-cd390678d081 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.170610 Aug 07 19:28:09.214340 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 113/236] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:09 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:09.985380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:09.985987 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:09.992372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:09.992824 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:09.993244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:09.993951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:09.994389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:09.994806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:10.127293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:10.135682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:10.137263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:10.138369 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c1b2ffa9-ae69-49b9-831a-538edd1e4ee0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.157156 Aug 07 19:28:10.138936 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 124/237] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:09 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:10.234941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:10.235519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:10.242526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:10.243018 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:10.243461 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:10.244228 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:10.244642 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:10.245071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:10.378321 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:10.385833 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0431f2cf-2ba9-426f-b0a1-fa4f40fb7bdb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.154794 Aug 07 19:28:10.391817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 114/238] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:10 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:11.160186 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:11.160779 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:11.167410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:11.167884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:11.168332 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:11.169029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:11.169487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:11.169906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:11.313120 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:11.322207 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:11.324094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:11.325384 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d017a806-6d96-4195-9727-d74883b9ea03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.169200 Aug 07 19:28:11.325989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 125/239] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:11 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:11.410320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:11.411377 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:11.419279 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:11.419842 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:11.420110 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:11.421024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:11.422153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:11.423117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:11.558349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:11.566733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a92575d-ed92-4d40-99d0-9af7483fd2e4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.163743 Aug 07 19:28:11.567494 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 115/240] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:11 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:12.349621 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:12.350266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:12.352463 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:12.361020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:12.361656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:12.362123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:12.362946 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:12.363434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:12.363884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:12.507028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:12.515543 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:12.517082 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:12.518218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0e13bb30-5035-4c68-ac3a-9e953714d65d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.172640 Aug 07 19:28:12.518748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 126/241] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:12 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:12.591879 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:12.592613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:12.599507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:12.600023 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:12.600518 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:12.601228 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:12.601680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:12.602088 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:12.748720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:12.756774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-96dd434a-fa21-442a-bca2-cb5f0b59039c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.168950 Aug 07 19:28:12.757398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 116/242] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:12 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:13.540681 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:13.541362 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:13.543954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:13.544892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=12 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:13.551314 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:13.551877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:13.552348 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:13.553133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:13.553594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:13.554023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:13.791937 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:13.802128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:13.826176 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:13.827562 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:13.828759 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:13.830426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:13.834162 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:13.837738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:14.075152 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:14.095044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:14.102077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:14.104273 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b864c748-87bf-4daf-8046-477aca5edffc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.567493 Aug 07 19:28:14.105755 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 127/243] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:13 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:14.137996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:14.153301 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-adce6cec-95b9-47a8-8d93-9ab5484e5073 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.378477 Aug 07 19:28:14.154677 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 117/244] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:13 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:14.794424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:14.795814 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:14.803525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:14.804372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:14.805059 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:14.806091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:14.806892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:14.807520 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:14.854107 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2878ac6e-f587-495b-bf6b-2c980b4b329d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/ips" status: 200 len: 145 microversion: 2.1 time: 0.065868 Aug 07 19:28:14.855105 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 128/245] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:28:14 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:15.127106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:15.127953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:15.135166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:15.135675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:15.136130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:15.136960 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:15.137411 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:15.137846 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:15.143732 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:15.177256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:15.178018 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:15.184200 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:15.184710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:15.185479 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:15.186295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:15.186758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:15.187185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:15.367843 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:15.376315 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:15.377517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:15.379905 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:15.380669 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bfa4a22e-e455-42ca-9d85-3a0214199491 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.257539 Aug 07 19:28:15.381468 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 118/246] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:15 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:15.384780 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-480518c8-0631-4dd5-adb2-90a5d52d4e14 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.211938 Aug 07 19:28:15.385353 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 129/247] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:15 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:16.403984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:16.404869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:16.405449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:16.406054 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:16.412277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:16.413040 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:16.413345 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:16.413484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:16.413810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:16.414180 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:16.414354 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:16.414638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:16.415044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:16.415140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:16.415487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:16.416333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:16.614076 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:16.625586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:16.628568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:16.630231 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:16.631363 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ab8569d3-9ce0-42bb-902e-d287f02ae5e1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.231571 Aug 07 19:28:16.631960 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 119/248] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:16 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:16.634297 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-710beea2-6793-4842-8d30-df587f7118bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.232634 Aug 07 19:28:16.634865 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 130/249] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:16 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:17.654152 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:17.654841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:17.656287 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:17.657084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:17.662419 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:17.663692 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:17.663692 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:17.664069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:17.664069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:17.664227 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:17.664453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:17.664560 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:17.664923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:17.665221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:17.665703 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:17.666139 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:17.888764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:17.893164 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:17.896745 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c3885ab3-7cb8-49a6-8731-01c7b7ae9e33 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.245110 Aug 07 19:28:17.897437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 131/250] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:17 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:17.903796 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:17.906671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:17.907397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d68ba627-c909-484b-a3c8-34429d0eeb68 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.257752 Aug 07 19:28:17.908384 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 120/251] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:17 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:18.930162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:18.930162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:18.936393 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:18.936869 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:18.937289 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:18.937982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:18.938432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:18.938937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:18.938937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:18.940439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:18.949386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:18.949912 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:18.950640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:18.951907 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:18.952459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:18.953082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:19.184947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:19.193417 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dada071a-7cf1-42bb-b71e-a6caa77111ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.268145 Aug 07 19:28:19.194013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 132/252] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:18 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:19.210772 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:19.231478 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:19.233095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:19.234299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f0a917ac-5eb3-4fac-8cee-e469fd7c787e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.301242 Aug 07 19:28:19.234911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 121/253] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:18 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:28:19.293723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9c79e5-faef-4eaa-ac83-d4f27584e5d4"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:19.297497 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:19.304490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:19.304982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:19.305411 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:19.306296 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:19.306811 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:19.307274 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:19.623631 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:19.798576 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-e879c19d-533d-44f5-9737-252cc693bc3b req-8aac1f1f-5840-41c5-91bb-4c1973316267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20345500-7cc0-4cd4-9c7a-35fc42ba4a32", "name": "network-vif-plugged", "status": "completed", "tag": "a274bf48-e334-42be-b1f2-d9db7f626a04"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:19.810659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e879c19d-533d-44f5-9737-252cc693bc3b req-8aac1f1f-5840-41c5-91bb-4c1973316267 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:19.811561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e879c19d-533d-44f5-9737-252cc693bc3b req-8aac1f1f-5840-41c5-91bb-4c1973316267 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:19.812369 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e879c19d-533d-44f5-9737-252cc693bc3b req-8aac1f1f-5840-41c5-91bb-4c1973316267 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:19.818149 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-73682864-2ff6-4a80-a4b1-d54630876412 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526821 Aug 07 19:28:19.818895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 133/254] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:28:19 2022] POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-volume_attachments => generated 194 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:19.850328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-e879c19d-533d-44f5-9737-252cc693bc3b req-8aac1f1f-5840-41c5-91bb-4c1973316267 service nova] Creating event network-vif-plugged:a274bf48-e334-42be-b1f2-d9db7f626a04 for instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 on hv-cinder-85032 Aug 07 19:28:19.862687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-e879c19d-533d-44f5-9737-252cc693bc3b req-8aac1f1f-5840-41c5-91bb-4c1973316267 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066383 Aug 07 19:28:19.863553 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 122/255] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:28:20.223665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:20.224683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:20.230954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:20.231406 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:20.231828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:20.232553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:20.233603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:20.233603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:20.267252 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:20.269192 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:20.275846 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:20.276368 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:20.276821 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:20.277681 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:20.277957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:20.279011 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:20.417064 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:20.426305 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4b4c206b-9b7e-45ca-90e4-c845aa8a0ce3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.207458 Aug 07 19:28:20.427021 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 134/256] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:20 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:20.459458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:20.468718 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:20.470220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:20.471337 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e8013dc7-3716-49c2-8208-b34e08f72ba6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.208974 Aug 07 19:28:20.471908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 123/257] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:20 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:28:20.662767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5e70a374-da24-44a6-943d-56b05477df71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: .version_select at 0x7fd476e04940>, body: {"keypair": {"name": "tempest-keypair-1312898459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIUBfsudJ2kPhWQVm03P6gh2LqWpQzpKmZIFUBWKI1YTWH0eRlgNhs3epKoUXv5r2W29rTdomcg69AUj3+BX6EkoYthuzEfHcNxd70FE1pPHaTnJOfSV91blIv6pHPhxA=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:20.679278 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-5e70a374-da24-44a6-943d-56b05477df71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:28:20.683576 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-5e70a374-da24-44a6-943d-56b05477df71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:28:20.709026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5e70a374-da24-44a6-943d-56b05477df71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051049 Aug 07 19:28:20.710179 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 135/258] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:28:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:21.448878 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:21.450178 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:21.457822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:21.458370 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:21.459064 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:21.459678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:21.460152 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:21.460629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:21.501749 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:21.502468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:21.510193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:21.510669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:21.511102 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:21.511787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:21.512622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:21.512725 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:21.761629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:21.771875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b77a21f1-1883-41fc-a0d5-57738447cf59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.327338 Aug 07 19:28:21.772596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 124/259] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:21 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:21.794078 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:21.805357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:21.806943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:21.808391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-459c3d4a-1e3f-4d14-8ba6-d4aa2d1a3573 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.310803 Aug 07 19:28:21.822929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 136/260] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:21 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:22.328553 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1717162323", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc78dd60-2af8-48f0-9dbc-66b27c087d3d"}], "security_groups": [{"name": "tempest-securitygroup--555746922"}], "key_name": "tempest-keypair-1312898459", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:22.445049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] validate_networks() for [('fc78dd60-2af8-48f0-9dbc-66b27c087d3d', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:28:22.794343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:22.795038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:22.802754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:22.803241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:22.803671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:22.804467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:22.804825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:22.805449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:22.860189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:28:22.860677 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:28:22.861283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:28:22.861715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:28:22.862154 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:28:22.871232 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:22.871605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:22.872040 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:22.872767 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:22.873216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:22.873631 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:22.891271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:28:22.895684 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:28:22.908069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:28:22.910413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:28:22.948387 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:22.956218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e7f2c2c3-ce9e-4469-98bc-114b9e44ee4e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.166389 Aug 07 19:28:22.956900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 137/261] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:22 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:22.963635 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:22.964284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:22.970758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:22.971254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:22.971686 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:22.972610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:22.973251 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:22.973686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b4bdc783-e3d4-40f0-ac08-931043cdc056 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.652765 Aug 07 19:28:22.976073 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:22.976222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 125/262] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:28:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:28:22.987156 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d27f7bb2-ae15-46e3-bafb-7491bd1ef166 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:22.987785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d27f7bb2-ae15-46e3-bafb-7491bd1ef166 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:23.057254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d27f7bb2-ae15-46e3-bafb-7491bd1ef166 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:23.065104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d27f7bb2-ae15-46e3-bafb-7491bd1ef166 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1242 microversion: 2.1 time: 0.083298 Aug 07 19:28:23.065774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 126/263] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:22 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:23.189056 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:23.197595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:23.199299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:23.200478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c19f9983-d775-482b-9e6e-9b4bb87fc0a3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.242656 Aug 07 19:28:23.201040 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 138/264] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:22 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:23.978303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:23.978894 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:23.986016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:23.986668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:23.987112 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:23.987819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:23.988329 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:23.988757 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:24.100588 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:24.101412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:24.109528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:24.110047 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:24.110479 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:24.111193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:24.111693 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:24.112196 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:24.133530 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:24.142150 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c828055e-5363-493f-b531-680bc4447415 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.167587 Aug 07 19:28:24.142878 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 127/265] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:23 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:24.187802 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:24.196839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b39120e9-e48b-470f-99f0-32be2e75fe19 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1246 microversion: 2.1 time: 0.103014 Aug 07 19:28:24.197424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 139/266] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:24 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:24.222848 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:24.223456 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:24.229527 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:24.230013 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:24.230458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:24.231192 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:24.231636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:24.232137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:24.360792 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:24.369142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:24.370663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:24.371767 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0c662996-38c2-40c8-90d4-0ab7e3eabd1d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.152916 Aug 07 19:28:24.372366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 128/267] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:24 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:25.170445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:25.171027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:25.178570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:25.179076 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:25.179473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:25.180205 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:25.180665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:25.181077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:25.218181 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:25.218825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:25.226278 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:25.226775 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:25.227211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:25.227902 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:25.228392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:25.228825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:25.309317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:25.320488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-10aaedb7-54b8-457f-bb5e-f014a7398a48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1246 microversion: 2.1 time: 0.103796 Aug 07 19:28:25.320488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 129/268] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:25 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:25.344872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:25.352581 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b2a1b475-27a1-4d39-8fb0-adb3e346c2f8 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.186143 Aug 07 19:28:25.353138 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 140/269] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:25 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:25.395904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:25.396665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:25.403051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:25.403642 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:25.404114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:25.404871 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:25.405582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:25.405919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:25.547012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:25.555966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:25.557498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:25.558620 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ffffc1d-a6c1-4c3f-b17b-752586792f9e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.167440 Aug 07 19:28:25.559199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 130/270] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:25 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:26.338719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:26.339369 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:26.346088 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:26.348012 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:26.348012 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:26.348690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:26.348690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:26.349109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:26.378237 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:26.379320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:26.403602 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:26.404479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:26.405233 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:26.406430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:26.407473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:26.408627 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:26.431843 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:26.439383 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7cb7c9b8-7a8c-4449-ac62-384e9754d716 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1246 microversion: 2.1 time: 0.104439 Aug 07 19:28:26.440164 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 141/271] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:26 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:26.549641 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:26.561527 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b2b6357-90e5-4bd8-8969-53f4a27e7030 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.190493 Aug 07 19:28:26.562834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 131/272] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:26 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:26.586845 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:26.587451 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:26.594006 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:26.594484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:26.594916 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:26.595705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:26.596215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:26.596655 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:26.741962 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:26.751180 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:26.752850 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:26.753947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c0eda50e-b182-48b3-b1ab-7ef10c061543 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.171059 Aug 07 19:28:26.754796 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 142/273] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:26 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:27.460934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:27.461449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:27.469057 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:27.469549 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:27.469982 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:27.470749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:27.471240 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:27.471666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:27.533715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:27.542778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-568bc7a7-1d9b-4dba-a18b-b44190433226 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1294 microversion: 2.1 time: 0.086221 Aug 07 19:28:27.543459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 132/274] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:27 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:27.583413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:27.584147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:27.590668 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:27.591221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:27.591766 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:27.592663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:27.593104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:27.593613 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:27.731730 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:27.739628 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aa97e174-47eb-46eb-9590-067ae4e45351 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.160061 Aug 07 19:28:27.740206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 143/275] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:27 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:27.777148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:27.777900 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:27.784782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:27.785269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:27.785709 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:27.786436 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:27.786890 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:27.787311 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:27.921888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:27.930498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:27.932010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:27.933183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ce486db4-b56e-4022-b16a-92d4ae4ca0d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1406 microversion: 2.20 time: 0.160184 Aug 07 19:28:27.933749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 133/276] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:27 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:28.564511 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:28.565123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:28.571333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:28.571823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:28.572268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:28.572959 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:28.573406 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:28.573824 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:28.640821 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:28.649968 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4a47e78e-6e62-44bc-8a70-a8aa00699a90 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1294 microversion: 2.1 time: 0.089417 Aug 07 19:28:28.650592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 144/277] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:28 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:28.760781 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:28.761483 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:28.769154 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:28.769633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:28.770117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:28.771157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:28.771596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:28.772031 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:28.925624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:28.934055 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3cb69522-4174-413c-b317-91873332b7b3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.177341 Aug 07 19:28:28.934769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 134/278] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:28 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:28.954877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:28.955480 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:28.961469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:28.961973 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:28.963077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:28.963077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:28.963510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:28.963924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:29.103977 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:29.112380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:29.113956 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:29.115156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f485fb2-ab1b-439e-8c48-925a2987533f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1598 microversion: 2.20 time: 0.164299 Aug 07 19:28:29.115750 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 145/279] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:28:28 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:28:29.137555 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:29.138130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:29.144949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:29.145598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:29.146229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:29.146880 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:29.147390 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:29.147866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:29.226864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-70d17c67-0e84-4c2c-8e88-99df5da650d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093445 Aug 07 19:28:29.227466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 135/280] 10.222.0.17 () {60 vars in 1316 bytes} [Sun Aug 7 19:28:29 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:28:29.673841 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:29.674651 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:29.681687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:29.682370 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:29.682802 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:29.683538 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:29.685145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:29.685145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:29.793551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:29.798230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-95dde37a-ddf7-4284-a250-68a8ea87e764 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1302 microversion: 2.1 time: 0.129548 Aug 07 19:28:29.798825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 146/281] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:29 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1302 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:29.955760 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:29.956407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:29.968913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:29.969404 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:29.969985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:29.970697 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:29.971137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:29.971581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:30.355475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:30.363143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3789c70c-9a0e-4f2d-a62f-f44fa37df6ea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.411899 Aug 07 19:28:30.363707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 136/282] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:29 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:30.587797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-edd7c0d9-bacc-47d3-b306-69ef74e0facb req-8a0188ef-73ba-4738-8e74-ae48dfb38711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20345500-7cc0-4cd4-9c7a-35fc42ba4a32", "tag": "a274bf48-e334-42be-b1f2-d9db7f626a04"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:30.597529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-edd7c0d9-bacc-47d3-b306-69ef74e0facb req-8a0188ef-73ba-4738-8e74-ae48dfb38711 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:30.598011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-edd7c0d9-bacc-47d3-b306-69ef74e0facb req-8a0188ef-73ba-4738-8e74-ae48dfb38711 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:30.598435 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-edd7c0d9-bacc-47d3-b306-69ef74e0facb req-8a0188ef-73ba-4738-8e74-ae48dfb38711 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:30.750048 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:30.753134 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-edd7c0d9-bacc-47d3-b306-69ef74e0facb req-8a0188ef-73ba-4738-8e74-ae48dfb38711 service nova] Creating event network-changed:a274bf48-e334-42be-b1f2-d9db7f626a04 for instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 on hv-cinder-85032 Aug 07 19:28:30.758229 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-edd7c0d9-bacc-47d3-b306-69ef74e0facb req-8a0188ef-73ba-4738-8e74-ae48dfb38711 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173941 Aug 07 19:28:30.758816 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 147/283] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:30.823766 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:30.824895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:30.832372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:30.832819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:30.833679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:30.845643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:30.845643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:30.845643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:30.854496 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:30.899891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:30.907336 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6bff8ffa-6269-4c60-be76-b9115b20f340 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1302 microversion: 2.1 time: 0.091198 Aug 07 19:28:30.907945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 137/284] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:30 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:31.385467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:31.386273 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:31.392733 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:31.393295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:31.393815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:31.394574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:31.395103 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:31.395583 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:31.535726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:31.543826 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b27a464a-3d49-4fb9-8849-1d3913bfc335 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.163011 Aug 07 19:28:31.544478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 148/285] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:31 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:31.928587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:31.929210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:31.935879 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:31.936409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:31.936849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:31.937572 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:31.938032 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:31.938460 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:32.000416 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:32.008703 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f65ea973-38f9-4710-800b-688096cfd099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1302 microversion: 2.1 time: 0.083947 Aug 07 19:28:32.009492 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 138/286] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:31 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:32.567386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:32.567946 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:32.574835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:32.575324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:32.575756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:32.576480 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:32.576934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:32.577359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:32.715242 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:32.723524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f8845b5f-665a-4d22-b5e0-9b3371adde84 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.161091 Aug 07 19:28:32.724169 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 149/287] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:32 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:33.030162 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:33.030791 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:33.032685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:33.039088 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:33.039563 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:33.040016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:33.040742 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:33.041197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:33.041620 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:33.063691 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:33.119686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:33.127789 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc1a235c-888f-4fad-9d47-3977963708bb tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1302 microversion: 2.1 time: 0.101454 Aug 07 19:28:33.128924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 139/288] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:33 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:33.745195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:33.745827 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:33.752562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:33.753111 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:33.753486 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:33.754263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:33.754680 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:33.755101 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:33.911389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:33.919460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-28b05427-0acc-4bbe-ad80-ffb3ebe35e2d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.178317 Aug 07 19:28:33.920371 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 150/289] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:33 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:34.149728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:34.150392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:34.157462 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:34.158010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:34.158773 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:34.159508 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:34.159963 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:34.160409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:34.228881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:34.236662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f7576e01-ef73-44a3-ae73-beb5b89254f9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1300 microversion: 2.1 time: 0.091678 Aug 07 19:28:34.237415 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 140/290] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:34 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:34.941255 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:34.942060 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:34.949361 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:34.949847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:34.950281 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:34.950984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:34.951432 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:34.951852 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:34.957225 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:35.103057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:35.111133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5ae602fb-a193-4f80-ae71-3c3c51cf0df3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1502 microversion: 2.1 time: 0.173967 Aug 07 19:28:35.112912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 151/291] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:34 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:35.132013 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d790a2cb-8b86-4b7d-bbf9-d628321f5f18"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:35.135168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:35.141341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.141827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.142261 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.143051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.143499 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.143925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.167498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] HTTP exception thrown: Cannot 'attach_volume' instance 5acd4751-94cc-4386-8cfc-e47567370bae while it is in vm_state rescued Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Request method failure captured: Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae/os-volume_attachments HTTP/1.1 Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 74 Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHUMfeFcA0vPGrwcpD6to5-Zis3n4fh-7LM-v1CVIs7l3u3s2eJuzUJybzvMYervGLtni9GY8diy5ko9vV5_IP4WfE29PaoJ24OcBgSzpbd8LA84m8WPg6rCiv4_d1Wt5OeqT-UVubX1pgJV4YSeE4nfCHEXDU4J0aZxILPfucZIl4 Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:28:35.169861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fe60f1637744c3f8a25e83f48bfdf71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: f643fd4ee6bc4ccfae45f3b8523ae46a Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "d790a2cb-8b86-4b7d-bbf9-d628321f5f18"}} Aug 07 19:28:35.171312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Cannot 'attach_volume' instance 5acd4751-94cc-4386-8cfc-e47567370bae while it is in vm_state rescued Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'server_id': '5acd4751-94cc-4386-8cfc-e47567370bae', 'body': {'volumeAttachment': {'volumeId': 'd790a2cb-8b86-4b7d-bbf9-d628321f5f18'}}} Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5acd4751-94cc-4386-8cfc-e47567370bae in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:28:35.172636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5acd4751-94cc-4386-8cfc-e47567370bae while it is in vm_state rescued Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:28:35.174297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:28:35.176021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:28:35.176021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:28:35.176021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5acd4751-94cc-4386-8cfc-e47567370bae while it is in vm_state rescued Aug 07 19:28:35.176021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:28:35.176021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Returning 409 to user: Cannot 'attach_volume' instance 5acd4751-94cc-4386-8cfc-e47567370bae while it is in vm_state rescued {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:28:35.176021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7a057a3b-8542-4770-b23d-6972ce138325 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043235 Aug 07 19:28:35.176021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 141/292] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:28:35 2022] POST /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 19:28:35.180992 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:35.181521 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:35.187540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.188055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.188492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.189182 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.189664 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.190083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.257866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:35.259028 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:35.259901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-20999eda-cf7f-4ab6-b974-3bbb1212062a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae/action" status: 202 len: 0 microversion: 2.1 time: 0.082654 Aug 07 19:28:35.260552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 152/293] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:28:35 2022] POST /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 19:28:35.266786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.267480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.268206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.269957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.270527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:35.271065 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.271569 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:35.271696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.280360 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.281076 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.281603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.282578 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.283123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.283778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.549714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:35.563047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8df0d65f-9f3c-4c5b-8aa2-b8f89cc40785 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.308310 Aug 07 19:28:35.565982 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 142/294] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:35 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:35.575389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:35.586387 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bee1b64c-3a70-4372-afce-b7d66444e7ad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1510 microversion: 2.1 time: 0.320100 Aug 07 19:28:35.601154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 153/295] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:35 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:35.707377 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f2ec8eef-c579-4008-a701-73866fe3fc29 req-70a994fe-50af-4dc6-b590-a2936af300b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc", "tag": "ac8f2ac6-a711-483f-af50-455a4c94eb35"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:35.712397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:35.718795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f2ec8eef-c579-4008-a701-73866fe3fc29 req-70a994fe-50af-4dc6-b590-a2936af300b0 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:35.718795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f2ec8eef-c579-4008-a701-73866fe3fc29 req-70a994fe-50af-4dc6-b590-a2936af300b0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:35.719194 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f2ec8eef-c579-4008-a701-73866fe3fc29 req-70a994fe-50af-4dc6-b590-a2936af300b0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:35.734474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f2ec8eef-c579-4008-a701-73866fe3fc29 req-70a994fe-50af-4dc6-b590-a2936af300b0 service nova] Creating event network-changed:ac8f2ac6-a711-483f-af50-455a4c94eb35 for instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc on hv-cinder-85032 Aug 07 19:28:35.740066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f2ec8eef-c579-4008-a701-73866fe3fc29 req-70a994fe-50af-4dc6-b590-a2936af300b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036633 Aug 07 19:28:35.741228 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 143/296] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:35.936039 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1558141098", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1815908904", "security_groups": [{"name": "tempest-secgroup-smoke-562769003"}], "networks": [{"uuid": "608a22e3-2bc7-468c-97e4-90f0a03f7cf4"}], "block_device_mapping_v2": [{"uuid": "578c5cea-0ed9-474e-954f-163181e381b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:36.065829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] validate_networks() for [('608a22e3-2bc7-468c-97e4-90f0a03f7cf4', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:28:36.525904 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:28:36.527008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:28:36.527484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:28:36.527924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:28:36.528761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:28:36.540652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:36.541243 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:36.541759 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:36.542583 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:36.543112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:36.544239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:36.569505 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Getting quotas for project 6e5e8fba8d65419393ba9829cafdd5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:28:36.573754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Getting quotas for user dbec912e4d5c4c6aabed5a98b6aa632d and project 6e5e8fba8d65419393ba9829cafdd5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:28:36.590418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:36.592340 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:36.603855 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:36.605546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:36.606872 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:36.608600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:36.609484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:36.609998 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:36.699898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:28:36.702743 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='578c5cea-0ed9-474e-954f-163181e381b3',volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:28:36.908886 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:36.914783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ccda8a1b-780c-43cd-8a71-beb8b743ae5a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.982681 Aug 07 19:28:36.915414 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 154/297] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:28:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:28:36.925467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:36.926161 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:36.935801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cd604cf0-3ba5-47ad-900d-01efa1a39228 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.352196 Aug 07 19:28:36.940054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 144/298] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:36 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:36.941474 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:36.943715 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:36.946364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:36.948277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:36.948899 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:36.949338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fcdd4d22-009a-4045-9f16-55bbfddef180 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:36.950941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:36.951468 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fcdd4d22-009a-4045-9f16-55bbfddef180 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:37.071682 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fcdd4d22-009a-4045-9f16-55bbfddef180 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:37.102740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fcdd4d22-009a-4045-9f16-55bbfddef180 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1089 microversion: 2.1 time: 0.161331 Aug 07 19:28:37.103852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 145/299] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:36 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1089 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:37.109584 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5c5131b6-0ce4-4a27-9b0d-f011d0113b97 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:37.117186 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c5131b6-0ce4-4a27-9b0d-f011d0113b97 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:37.117945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c5131b6-0ce4-4a27-9b0d-f011d0113b97 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:37.118540 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c5131b6-0ce4-4a27-9b0d-f011d0113b97 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:37.196980 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5c5131b6-0ce4-4a27-9b0d-f011d0113b97 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Going to try to stop instance {{(pid=117832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 19:28:37.258659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:37.268406 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b0bde37d-c3c5-48fd-8d42-925e2b70ba53 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1510 microversion: 2.1 time: 0.348396 Aug 07 19:28:37.269543 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 155/300] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:36 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:37.283310 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5c5131b6-0ce4-4a27-9b0d-f011d0113b97 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.177365 Aug 07 19:28:37.284445 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 146/301] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:28:37 2022] POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:28:37.308576 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:37.310517 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:37.324193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:37.324193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:37.324529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:37.325427 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:37.326051 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:37.326491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:37.467525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:37.479196 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c40551df-d1b1-4827-92c4-fac30c2031be tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.185680 Aug 07 19:28:37.479965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 156/302] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:37 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:37.959636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:37.960352 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:37.967135 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:37.967625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:37.968081 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:37.968767 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:37.969218 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:37.969635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:38.124842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:38.125212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:38.125729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:38.132898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:38.133557 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:38.133821 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-860279b4-bcab-4f02-b873-6ad45ed7354a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.178913 Aug 07 19:28:38.134955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 147/303] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:37 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:38.135828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:38.136684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:38.137096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:38.137648 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:38.208850 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:38.216635 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1382bb7b-07f4-4a90-8f67-d92d78e4d0cb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1139 microversion: 2.1 time: 0.096223 Aug 07 19:28:38.217193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 157/304] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:38 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:38.291105 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:38.291717 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:38.298597 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:38.299197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:38.299783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:38.300612 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:38.301008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:38.301426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:38.439154 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:38.447149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b411094-7fd0-4869-bf9b-5ecbed067537 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1510 microversion: 2.1 time: 0.160142 Aug 07 19:28:38.447691 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 148/305] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:38 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:38.502342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:38.502945 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:38.509211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:38.509661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:38.510338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:38.511028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:38.511483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:38.511870 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:38.652747 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:38.662583 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fb82c638-8b13-406b-be93-366d0a593b0e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.164095 Aug 07 19:28:38.663436 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 158/306] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:38 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:39.161439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:39.162108 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:39.180475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.180475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.180475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.180475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.180841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.180841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.238069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:39.238675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:39.245613 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.246356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.247401 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.247524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.247915 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.248370 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.341438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:39.349960 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e1f2216a-17d4-4f3e-9c23-4bb6898a1e73 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1131 microversion: 2.1 time: 0.116212 Aug 07 19:28:39.350784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 159/307] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:39 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1131 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:39.401713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:39.410269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-46b1c3ba-0ea6-49ca-9bc1-e553a80f9993 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.254430 Aug 07 19:28:39.411254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 149/308] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:39 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:39.469453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:39.470355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:39.478338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.478900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.479366 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.480470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.481009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.481506 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.638828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:39.647239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c8013369-9e31-43f9-b343-5ec79ce0636b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1516 microversion: 2.1 time: 0.182656 Aug 07 19:28:39.647816 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 160/309] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:39 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:39.684983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:39.685631 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:39.692028 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.692784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.693389 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.694580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:39.695549 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:39.696405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:39.850761 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:39.864385 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-57301e2b-36b7-4ec8-be04-5438d309fc2b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.183535 Aug 07 19:28:39.865913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 150/310] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:39 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:40.370838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:40.371440 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:40.378100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:40.378571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:40.379002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:40.379687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:40.380163 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:40.380564 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:40.432826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:40.433438 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:40.439856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:40.440362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:40.440785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:40.441478 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:40.441928 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:40.442350 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:40.449299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:40.457205 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aa11bd03-fe20-4520-9d53-660f44d2bb44 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1131 microversion: 2.1 time: 0.090118 Aug 07 19:28:40.458003 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 161/311] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:40 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1131 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:40.574016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:40.583078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c34eb8d7-6212-42f8-ac1d-3ac0e4f107e2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.154016 Aug 07 19:28:40.583687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 151/312] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:40 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:40.888325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:40.888953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:40.895272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:40.895754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:40.896264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:40.896958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:40.897405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:40.897828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:41.065903 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:41.076184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-96afdd5f-6674-42ac-8814-c54dddee49bd tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.191571 Aug 07 19:28:41.076934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 162/313] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:40 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:41.101083 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-301532f8-51d4-4b63-95c8-87a12274c51b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'create', calling method: .version_select at 0x7fd47c09e0d0>, body: {"keypair": {"name": "tempest-keypair-262878383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiAxpOfqt98meYlRpFm8VWsiz7E+O6gV7K2X2vcImzZuvm1M9LpjJzuqZL4W/ZGj7uygfkSZLzzNGVruSAKpjCBVfqprF+hjSjLxmD2Fdp7Tnn41UwnTWL/tjjNK9rHGA=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:41.116803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-301532f8-51d4-4b63-95c8-87a12274c51b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:28:41.120580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-301532f8-51d4-4b63-95c8-87a12274c51b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for user f643fd4ee6bc4ccfae45f3b8523ae46a and project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:28:41.146039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-301532f8-51d4-4b63-95c8-87a12274c51b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048838 Aug 07 19:28:41.146646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 152/314] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:28:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:41.481305 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:41.481948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:41.485566 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:41.493608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:41.494401 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:41.495108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:41.496308 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:41.496830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:41.497328 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:41.581138 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:41.593672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2de81a69-151b-48f3-b986-3011d9f036b5 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1187 microversion: 2.1 time: 0.119381 Aug 07 19:28:41.594563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 163/315] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:41 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:41.613290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:41.614377 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:41.623486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:41.624305 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:41.624803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:41.625592 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:41.626185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:41.626879 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:41.787191 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:41.795081 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fa852519-19ed-4272-a9fb-0da6be642cda tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.187927 Aug 07 19:28:41.795655 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 153/316] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:41 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:42.099384 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:42.100008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:42.107266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:42.107739 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:42.108353 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:42.109247 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:42.109689 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:42.110108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:42.256503 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:42.270277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2c053318-e77b-4bd5-9dc4-cb11ab920f0f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.175778 Aug 07 19:28:42.271154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 164/317] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:42 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:42.614528 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:42.615103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:42.622112 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:42.622673 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:42.623033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:42.623733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:42.624223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:42.624648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:42.712927 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:42.723227 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2acf8673-684b-4a8f-82be-987acbe01395 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1205 microversion: 2.1 time: 0.111839 Aug 07 19:28:42.725076 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 154/318] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:42 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1205 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:42.816829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:42.817784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:42.830221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:42.830771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:42.831380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:42.832122 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:42.832577 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:42.832996 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:42.991533 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:43.000649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-89c34837-65ae-43bb-972e-70d12211ef6f tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.187664 Aug 07 19:28:43.002781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 165/319] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:42 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:43.270480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1196506525", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f7ad20a-0a66-4922-a403-e50e551ba485"}], "security_groups": [{"name": "tempest-securitygroup--2124020438"}], "key_name": "tempest-keypair-262878383", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:43.292649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:43.293259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:43.301334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:43.310795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:43.313719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:43.315113 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:43.315786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:43.317374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:43.440954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] validate_networks() for [('6f7ad20a-0a66-4922-a403-e50e551ba485', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:28:43.599235 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:43.612972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a315a167-071a-416b-b294-e2d51f463fb4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.324004 Aug 07 19:28:43.614413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 166/320] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:43 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:43.748231 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:43.749284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:43.756253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:43.757153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:43.757740 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:43.758594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:43.760289 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:43.761148 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:43.788298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:43.978558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:43.987154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-07f9b877-5037-4479-87cb-f050799c5aab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.245926 Aug 07 19:28:43.992417 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 167/321] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:43 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:44.023649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:44.024304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:44.034296 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:44.034785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:44.035551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:44.036450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:44.036927 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:44.037855 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:44.098802 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:28:44.099379 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:28:44.100371 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:28:44.100780 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:28:44.101335 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:28:44.112696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:44.113297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:44.113858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:44.114715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:44.115269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:44.115797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:44.140071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:28:44.144738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Getting quotas for user f643fd4ee6bc4ccfae45f3b8523ae46a and project 0fe60f1637744c3f8a25e83f48bfdf71. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:28:44.156985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:28:44.159763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:28:44.209489 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:44.218124 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2d7d755b-7cea-4122-a4ed-c79d9cfa0a09 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.952899 Aug 07 19:28:44.219069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 155/322] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:28:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:28:44.224998 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-45ab50a0-0143-422e-b9f8-6c4078cc462a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.205401 Aug 07 19:28:44.226101 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 168/323] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:44 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:44.236197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c0648da6-ee2f-49b8-9ee6-25348f796ecd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:44.238165 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c0648da6-ee2f-49b8-9ee6-25348f796ecd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:44.301264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c0648da6-ee2f-49b8-9ee6-25348f796ecd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:44.314738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c0648da6-ee2f-49b8-9ee6-25348f796ecd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1245 microversion: 2.1 time: 0.084011 Aug 07 19:28:44.314838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 156/324] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:44 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:44.333011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-fda5cdc3-7f43-46dc-8a0e-259b0cae96cd req-9e455af7-c31f-47db-95f4-c20ab3c3bb8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6", "tag": "a441108c-e43e-4ecc-b113-5e6d2d30de08"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:44.346969 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fda5cdc3-7f43-46dc-8a0e-259b0cae96cd req-9e455af7-c31f-47db-95f4-c20ab3c3bb8a service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:44.347552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fda5cdc3-7f43-46dc-8a0e-259b0cae96cd req-9e455af7-c31f-47db-95f4-c20ab3c3bb8a service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:44.348075 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fda5cdc3-7f43-46dc-8a0e-259b0cae96cd req-9e455af7-c31f-47db-95f4-c20ab3c3bb8a service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:44.360099 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-fda5cdc3-7f43-46dc-8a0e-259b0cae96cd req-9e455af7-c31f-47db-95f4-c20ab3c3bb8a service nova] Creating event network-changed:a441108c-e43e-4ecc-b113-5e6d2d30de08 for instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 on hv-cinder-85032 Aug 07 19:28:44.365837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-fda5cdc3-7f43-46dc-8a0e-259b0cae96cd req-9e455af7-c31f-47db-95f4-c20ab3c3bb8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039928 Aug 07 19:28:44.366935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 169/325] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:44.635355 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:44.636247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:44.644582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:44.646243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:44.646801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:44.647737 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:44.648414 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:44.648996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:44.826149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:44.829876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:44.837542 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6921f023-3a1f-4842-9802-a854cf4f3a7b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.206359 Aug 07 19:28:44.838814 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 157/326] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:44 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:45.009539 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:45.010247 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:45.017385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.018058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.018838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.019741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.020638 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.021877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.181453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:45.191823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-09b2a2b9-5df5-4914-b1f6-ec2455c29a94 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.187267 Aug 07 19:28:45.192976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 170/327] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:45 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:45.249018 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:45.250042 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:45.262779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.263333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.263817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.264768 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.265437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.266092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.308218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-95f6965a-a79a-4376-8f83-c0385b6419a9 req-1a7dfc35-163d-4f23-ba6c-064a9ccad85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc", "name": "network-vif-plugged", "status": "completed", "tag": "ac8f2ac6-a711-483f-af50-455a4c94eb35"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:45.333302 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-95f6965a-a79a-4376-8f83-c0385b6419a9 req-1a7dfc35-163d-4f23-ba6c-064a9ccad85b service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.335864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-95f6965a-a79a-4376-8f83-c0385b6419a9 req-1a7dfc35-163d-4f23-ba6c-064a9ccad85b service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.336478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-95f6965a-a79a-4376-8f83-c0385b6419a9 req-1a7dfc35-163d-4f23-ba6c-064a9ccad85b service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.357691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-95f6965a-a79a-4376-8f83-c0385b6419a9 req-1a7dfc35-163d-4f23-ba6c-064a9ccad85b service nova] Creating event network-vif-plugged:ac8f2ac6-a711-483f-af50-455a4c94eb35 for instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc on hv-cinder-85032 Aug 07 19:28:45.375671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-95f6965a-a79a-4376-8f83-c0385b6419a9 req-1a7dfc35-163d-4f23-ba6c-064a9ccad85b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073198 Aug 07 19:28:45.379518 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 171/328] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:28:45.406674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:45.412617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:45.424895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.425881 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.426562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.428713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.429765 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.430695 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.466696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:45.474909 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-34ffeee9-2780-4237-9eb2-2fbfdebca6f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.230740 Aug 07 19:28:45.475481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 158/329] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:45 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:45.524386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:45.532377 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6910ef2c-4349-43ac-a1ff-143eddcaac64 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1297 microversion: 2.1 time: 0.149471 Aug 07 19:28:45.532951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 172/330] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:45 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1297 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:45.864171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:45.865263 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:45.872937 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.873521 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.873978 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:45.874675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:45.875122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:45.875535 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:46.071591 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:46.081830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9ea47469-cac4-444b-86a7-f1c981c990c2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.224068 Aug 07 19:28:46.083412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 159/331] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:45 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:46.216091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:46.216815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:46.223551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:46.224293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:46.224975 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:46.225749 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:46.226405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:46.226882 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:46.370795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:46.379429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1ef3ad3a-8e6f-4e76-a130-e35cb2e7f9eb tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.169393 Aug 07 19:28:46.379984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 173/332] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:46 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:46.496318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:46.497319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:46.503384 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:46.503931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:46.504484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:46.505301 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:46.505931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:46.506425 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:46.553636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:46.554888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:46.558371 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:46.562041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:46.562456 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:46.562883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:46.563568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:46.564140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:46.564503 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:46.598203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:46.650502 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:46.660131 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-79142e0c-f095-40b3-9af0-907bc5518d75 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1303 microversion: 2.1 time: 0.110243 Aug 07 19:28:46.660716 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 174/333] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:46 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:46.686089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:46.696478 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ff14d330-9f9e-40c6-a43e-ba4229dc7709 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.203827 Aug 07 19:28:46.708238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 160/334] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:46 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:47.104115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:47.104729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:47.111616 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.112335 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.112773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.113496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.113925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.114360 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.265652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:47.275197 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dffff0ee-c5de-424b-9e51-7f794b77c01f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.174934 Aug 07 19:28:47.275784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 175/335] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:47 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:47.399916 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:47.400563 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:47.407299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.407783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.408458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.409168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.409621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.410249 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.594062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:47.604596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-455c6183-0d49-46ff-8a81-a3b4c3ee5912 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.208505 Aug 07 19:28:47.605802 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 161/336] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:47 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:47.681949 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:47.683525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:47.690276 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.690763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.691387 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.692293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.692748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.693330 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.718322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:47.719381 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:47.740724 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.741616 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.743533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.744851 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:47.747766 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:47.748484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:47.793087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:47.803243 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-840003f8-9d09-46b1-9973-93fe57194eb3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1303 microversion: 2.1 time: 0.125024 Aug 07 19:28:47.804595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 176/337] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:47 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:47.931222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:47.940703 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca218901-ef60-459d-901e-37f47eff1e0a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1367 microversion: 2.1 time: 0.226115 Aug 07 19:28:47.941295 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 162/338] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:47 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:48.298454 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:48.299405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:48.308611 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.309120 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.309555 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:48.310259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.310707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.311128 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:48.463168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:48.471605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c8684566-57f4-4724-a3f9-31995e9154ae tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.177857 Aug 07 19:28:48.472102 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 177/339] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:48 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:48.627775 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:48.628925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:48.637221 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.637674 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.638413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:48.639282 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.639891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.640349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:48.799785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:48.807838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-16ac574e-2e9f-436f-9cfe-736b89bf0bfd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.185644 Aug 07 19:28:48.809846 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 163/340] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:48 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:48.829460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:48.830730 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:48.837442 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.838013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.838538 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:48.839468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.840063 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.840601 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:48.961726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:48.962733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:48.969218 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.970157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.970888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:48.971831 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:48.972526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:48.973192 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:49.036521 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:49.049582 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3ca4ecbe-e319-4a46-8519-bb7333ac3040 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.227137 Aug 07 19:28:49.050888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 178/341] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:48 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:49.289364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-15c22856-e4d5-476d-b9f8-09de4be4b477 req-d3f0a022-5049-4305-85ca-36a2a7802bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24bc3ee-0e1c-4532-8859-2c6e8a675b3b", "tag": "7789ece0-abb9-4195-8580-f0706364a37d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:49.300781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-15c22856-e4d5-476d-b9f8-09de4be4b477 req-d3f0a022-5049-4305-85ca-36a2a7802bb1 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:49.301666 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-15c22856-e4d5-476d-b9f8-09de4be4b477 req-d3f0a022-5049-4305-85ca-36a2a7802bb1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:49.302179 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-15c22856-e4d5-476d-b9f8-09de4be4b477 req-d3f0a022-5049-4305-85ca-36a2a7802bb1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:49.317618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-15c22856-e4d5-476d-b9f8-09de4be4b477 req-d3f0a022-5049-4305-85ca-36a2a7802bb1 service nova] Creating event network-changed:7789ece0-abb9-4195-8580-f0706364a37d for instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b on hv-cinder-85032 Aug 07 19:28:49.322412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-15c22856-e4d5-476d-b9f8-09de4be4b477 req-d3f0a022-5049-4305-85ca-36a2a7802bb1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037347 Aug 07 19:28:49.323489 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 179/342] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:28:49.369899 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:49.378516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc3d0bf2-a74b-4143-9070-533620c56b54 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1557 microversion: 2.1 time: 0.420318 Aug 07 19:28:49.379113 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 164/343] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:48 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1557 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:28:49.400445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:49.401005 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:49.407895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:49.408550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:49.409049 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:49.409817 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:49.410260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:49.410672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:49.493300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:49.493565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-80b4764c-8555-4cae-a199-78a07c648c92 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097694 Aug 07 19:28:49.494211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:49.494486 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 180/344] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:28:49 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:49.500919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:49.501594 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:49.502406 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:49.503185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:49.503830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:49.504506 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:49.789284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:49.799568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45325cf5-e7eb-4073-89b3-59219cf6e1cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.310431 Aug 07 19:28:49.812516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 165/345] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:49 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:49.832399 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:49.833716 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:49.840653 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:49.841198 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:49.841620 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:49.842480 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:49.842916 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:49.843343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:50.071892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:50.072937 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:50.079024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:50.079500 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:50.079973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:50.080709 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:50.081155 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:50.081570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:50.084938 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:50.092446 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f240007d-cdcd-49df-9a0b-020aefd8eb8d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.264940 Aug 07 19:28:50.097754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 181/346] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:49 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:50.340353 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:50.356618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d62f2109-56ec-4a92-a75b-cfae2327d336 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.288843 Aug 07 19:28:50.357509 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 166/347] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:50 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:50.753429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-54cc9253-fb08-4d5e-8a1e-84e933c4b3b1 req-87435802-9668-4142-ac48-e1a0d86910c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc", "tag": "ac8f2ac6-a711-483f-af50-455a4c94eb35"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:50.764149 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-54cc9253-fb08-4d5e-8a1e-84e933c4b3b1 req-87435802-9668-4142-ac48-e1a0d86910c7 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:50.764623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-54cc9253-fb08-4d5e-8a1e-84e933c4b3b1 req-87435802-9668-4142-ac48-e1a0d86910c7 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:50.765132 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-54cc9253-fb08-4d5e-8a1e-84e933c4b3b1 req-87435802-9668-4142-ac48-e1a0d86910c7 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:50.776839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-54cc9253-fb08-4d5e-8a1e-84e933c4b3b1 req-87435802-9668-4142-ac48-e1a0d86910c7 service nova] Creating event network-changed:ac8f2ac6-a711-483f-af50-455a4c94eb35 for instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc on hv-cinder-85032 Aug 07 19:28:50.781865 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-54cc9253-fb08-4d5e-8a1e-84e933c4b3b1 req-87435802-9668-4142-ac48-e1a0d86910c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032527 Aug 07 19:28:50.782691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 182/348] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:28:50.823450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:50.824194 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:50.831645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:50.832480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:50.833369 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:50.834079 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:50.834686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:50.835302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:50.990507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:50.999422 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eec1785d-3126-47b6-9ec8-6499cdb986ff tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.181534 Aug 07 19:28:51.000517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 167/349] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:50 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:51.115947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:51.116786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:51.123437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:51.124074 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:51.124554 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:51.125299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:51.125830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:51.126359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:51.279766 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:51.287724 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7b9d7df7-95d6-4fd5-a0f8-6c0d42345ec4 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.176861 Aug 07 19:28:51.288322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 183/350] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:51 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:51.378408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:51.378997 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:51.385632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:51.386124 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:51.386549 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:51.387252 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:51.387702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:51.388162 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:51.532568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:51.540961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cd5cd394-e32b-4250-946a-370af8a3529a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.166787 Aug 07 19:28:51.541666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 168/351] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:51 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:52.025377 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:52.025988 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:52.032923 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:52.033475 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:52.033903 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:52.034593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:52.035052 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:52.035477 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:52.172831 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:52.181464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-57eccaee-6815-4024-8fa7-8b2c33c0cfa8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.159976 Aug 07 19:28:52.182004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 184/352] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:52 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:52.312402 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:52.313084 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:52.320508 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:52.321002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:52.321451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:52.322146 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:52.322599 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:52.323020 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:52.463192 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:52.471097 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8b838e9f-f8d5-4d91-86eb-6812c40ec588 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.165441 Aug 07 19:28:52.471756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 169/353] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:52 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:52.562963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:52.563715 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:52.570851 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:52.571338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:52.571775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:52.572501 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:52.572954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:52.573390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:52.713266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:52.720970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-19bd0392-c74f-4c38-80bf-0f555c9bba59 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.162585 Aug 07 19:28:52.721544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 185/354] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:52 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:53.202413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:53.203217 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:53.209760 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:53.210317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:53.210984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:53.211725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:53.212375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:53.213001 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:53.354362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:53.363432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a9749a5d-4bdd-4970-9e23-11cb0eb5c986 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.164949 Aug 07 19:28:53.376813 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 170/355] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:53 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:53.492253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:53.493413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:53.500090 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:53.500836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:53.501229 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:53.502284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:53.503017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:53.503590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:53.699232 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:53.710952 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d1ea802d-4406-4eee-82bb-42a516ae9a27 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.222613 Aug 07 19:28:53.711626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 186/356] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:53 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:53.741943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:53.742672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:53.749389 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:53.749908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:53.750348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:53.751023 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:53.751680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:53.752364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:53.895346 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:53.903184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c2be6d4a-8301-4b5b-99b1-4bddf52165dc tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.165208 Aug 07 19:28:53.903754 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 171/357] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:53 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:54.389020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:54.389622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:54.397754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:54.398446 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:54.399028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:54.399806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:54.400329 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:54.400753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:54.405846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:54.540272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:54.549269 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-323a9b09-57a6-4d48-8fab-6e841393c4eb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.164287 Aug 07 19:28:54.549845 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 187/358] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:54 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:54.732475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:54.733090 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:54.734990 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:54.735977 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=14 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:54.742784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:54.743292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:54.743746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:54.744614 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:54.745069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:54.745509 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:54.889830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:54.898781 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca5446d0-db65-4e8e-9ad5-f126a4510d1a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.169739 Aug 07 19:28:54.900043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 172/359] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:54 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:54.926038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:54.926646 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:54.934078 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:54.934078 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:54.934372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:54.934811 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:54.935267 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:54.935684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:55.084184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:55.092210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9252c2f4-48ea-4a0e-972f-5f1c709095f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.170580 Aug 07 19:28:55.092782 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 188/360] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:54 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:55.507079 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8ac77d2c-cefa-443e-a5fa-03a285924710 req-9be0cf20-b306-4b88-9784-eeb8a52d1c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24bc3ee-0e1c-4532-8859-2c6e8a675b3b", "name": "network-vif-plugged", "status": "completed", "tag": "7789ece0-abb9-4195-8580-f0706364a37d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:55.519098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8ac77d2c-cefa-443e-a5fa-03a285924710 req-9be0cf20-b306-4b88-9784-eeb8a52d1c49 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:55.519578 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8ac77d2c-cefa-443e-a5fa-03a285924710 req-9be0cf20-b306-4b88-9784-eeb8a52d1c49 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:55.520081 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8ac77d2c-cefa-443e-a5fa-03a285924710 req-9be0cf20-b306-4b88-9784-eeb8a52d1c49 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:55.533835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8ac77d2c-cefa-443e-a5fa-03a285924710 req-9be0cf20-b306-4b88-9784-eeb8a52d1c49 service nova] Creating event network-vif-plugged:7789ece0-abb9-4195-8580-f0706364a37d for instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b on hv-cinder-85032 Aug 07 19:28:55.539326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8ac77d2c-cefa-443e-a5fa-03a285924710 req-9be0cf20-b306-4b88-9784-eeb8a52d1c49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035931 Aug 07 19:28:55.539949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 173/361] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:55.579172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:55.579921 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:55.587388 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:55.587876 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:55.588375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:55.589058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:55.589523 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:55.589941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:55.749080 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:55.759131 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-19c1f54e-7ba6-42c7-957f-9db9b0bbe3ad tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.184080 Aug 07 19:28:55.759931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 189/362] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:55 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:55.922421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:55.923153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:55.929889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:55.930391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:55.930830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:55.931544 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:55.932019 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:55.932458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:56.074114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:56.081906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dc54143a-2974-4711-b69b-64a25ea1f587 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.164722 Aug 07 19:28:56.082509 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 174/363] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:55 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:56.114025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:56.114626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:56.120768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:56.121250 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:56.121683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:56.122374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:56.122828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:56.123239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:56.275900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:56.286204 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ba150068-9d9b-472d-8393-c1ea6f239b91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.176021 Aug 07 19:28:56.286785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 190/364] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:56 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:56.780602 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:56.781571 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:56.788888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:56.789502 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:56.789821 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:56.790729 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:56.790989 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:56.791420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:56.795888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:56.952410 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:56.961731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-de87ce83-e87b-44df-8255-b12130a15c0d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.185724 Aug 07 19:28:56.962314 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 175/365] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:56 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:57.107925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:57.108705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:57.128213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:57.128213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:57.128213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:57.128213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:57.128590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:57.128590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:57.296211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:57.302438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ea11640d-3d2d-47da-97ea-2d5bab8c6155 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.199479 Aug 07 19:28:57.303037 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 191/366] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:57 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:57.308942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:57.309560 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:57.326795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:57.327290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:57.331650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:57.332629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:57.333244 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:57.333838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:57.505457 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:57.516484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-81634540-32f7-45ab-93e0-50a3ff0f9d73 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1371 microversion: 2.1 time: 0.213072 Aug 07 19:28:57.517495 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 176/367] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:57 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:57.756404 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ef3633c6-eb5e-40f0-942c-9c066c85efc1 req-d2d9c5bd-e2b8-4ed7-932e-a3ca5b75a536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6", "name": "network-vif-plugged", "status": "completed", "tag": "a441108c-e43e-4ecc-b113-5e6d2d30de08"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:57.768436 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ef3633c6-eb5e-40f0-942c-9c066c85efc1 req-d2d9c5bd-e2b8-4ed7-932e-a3ca5b75a536 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:57.768436 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ef3633c6-eb5e-40f0-942c-9c066c85efc1 req-d2d9c5bd-e2b8-4ed7-932e-a3ca5b75a536 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:57.768695 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ef3633c6-eb5e-40f0-942c-9c066c85efc1 req-d2d9c5bd-e2b8-4ed7-932e-a3ca5b75a536 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:57.782184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ef3633c6-eb5e-40f0-942c-9c066c85efc1 req-d2d9c5bd-e2b8-4ed7-932e-a3ca5b75a536 service nova] Creating event network-vif-plugged:a441108c-e43e-4ecc-b113-5e6d2d30de08 for instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 on hv-cinder-85032 Aug 07 19:28:57.788409 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ef3633c6-eb5e-40f0-942c-9c066c85efc1 req-d2d9c5bd-e2b8-4ed7-932e-a3ca5b75a536 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035467 Aug 07 19:28:57.789014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 192/368] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:57.982908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:57.983500 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:57.990393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:57.990874 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:57.991296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:57.992012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:57.992459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:57.992877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:58.167784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:58.177102 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a125134f-fff6-41f0-92b6-31aff6bc6e82 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1722 microversion: 2.1 time: 0.197958 Aug 07 19:28:58.177696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 177/369] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:57 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:58.324055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:58.325011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:58.333269 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:58.333891 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:58.334162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:58.334996 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:58.335475 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:58.335929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:58.495850 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:58.504542 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cb4f5d5e-99d9-4d7b-87c0-14db72ea0d77 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.185337 Aug 07 19:28:58.505937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 193/370] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:58 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:58.537685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:58.538454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:58.540652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:58.547394 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:58.548221 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:58.548981 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:58.549844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:58.550494 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:58.551211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:58.695598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:58.704069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c740d02-05c2-4573-b274-71fc4928da2b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1565 microversion: 2.1 time: 0.170779 Aug 07 19:28:58.704652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 178/371] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:58 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:58.726938 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:58.727496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:58.733512 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:58.733986 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:58.734614 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:58.735309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:58.735749 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:58.736253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:58.838071 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ffb4f477-df00-4268-b467-59c21755c19d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114522 Aug 07 19:28:58.838515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 194/372] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:28:58 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:28:59.200368 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:59.201735 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:59.210812 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:59.211314 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:59.211736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:59.212819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:59.213489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:59.213918 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:59.364992 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:59.373966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0e4d2590-a3b0-4f09-a503-0b00b7a85249 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1699 microversion: 2.1 time: 0.177677 Aug 07 19:28:59.374985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 179/373] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:59 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1699 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:59.396066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6c4afc29-ba55-42a0-a077-a8fd0c4699e8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:28:59.404395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c4afc29-ba55-42a0-a077-a8fd0c4699e8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:59.405323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c4afc29-ba55-42a0-a077-a8fd0c4699e8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:59.405765 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c4afc29-ba55-42a0-a077-a8fd0c4699e8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:59.471234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6c4afc29-ba55-42a0-a077-a8fd0c4699e8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Going to try to start instance {{(pid=117833) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 19:28:59.521532 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6c4afc29-ba55-42a0-a077-a8fd0c4699e8 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.129896 Aug 07 19:28:59.522571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 195/374] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:28:59 2022] POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:28:59.532984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:59.534321 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:59.542111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:59.542767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:28:59.542922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:59.543458 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:28:59.543601 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:59.545137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:59.545811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:59.546715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:59.551381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:59.551871 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:59.552365 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:59.553042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:28:59.553497 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:28:59.553919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:28:59.826153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:59.834436 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3bd0d891-37a0-4829-94e0-428d1168474a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1260 microversion: 2.1 time: 0.296485 Aug 07 19:28:59.834983 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 196/375] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:59 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:28:59.855242 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:28:59.864620 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-270668dc-2e0b-415c-ad33-24ee18b3516d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1708 microversion: 2.1 time: 0.337236 Aug 07 19:28:59.865535 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 180/376] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:28:59 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1708 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:29:00.327053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-f423b7b1-6855-4e6d-8dba-3e7a80ed5d74 req-e324be0c-dd6d-4f41-9c2b-20b646b2154c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24bc3ee-0e1c-4532-8859-2c6e8a675b3b", "tag": "7789ece0-abb9-4195-8580-f0706364a37d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:00.338087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f423b7b1-6855-4e6d-8dba-3e7a80ed5d74 req-e324be0c-dd6d-4f41-9c2b-20b646b2154c service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:00.338590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f423b7b1-6855-4e6d-8dba-3e7a80ed5d74 req-e324be0c-dd6d-4f41-9c2b-20b646b2154c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:00.339040 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f423b7b1-6855-4e6d-8dba-3e7a80ed5d74 req-e324be0c-dd6d-4f41-9c2b-20b646b2154c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:00.351784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-f423b7b1-6855-4e6d-8dba-3e7a80ed5d74 req-e324be0c-dd6d-4f41-9c2b-20b646b2154c service nova] Creating event network-changed:7789ece0-abb9-4195-8580-f0706364a37d for instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b on hv-cinder-85032 Aug 07 19:29:00.357984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-f423b7b1-6855-4e6d-8dba-3e7a80ed5d74 req-e324be0c-dd6d-4f41-9c2b-20b646b2154c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034275 Aug 07 19:29:00.358600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 197/377] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:00.854981 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:00.857203 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:00.862437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:00.863172 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:00.863768 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:00.864682 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:00.865282 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:00.865850 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:00.887492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:00.888800 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:00.898612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:00.905162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:00.905924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:00.908061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:00.910931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:00.913689 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:01.209148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:01.221995 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:01.232896 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-180f10a6-d89c-49d6-9adb-919df9cb8989 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1708 microversion: 2.1 time: 0.350583 Aug 07 19:29:01.235517 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 198/378] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:00 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1708 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:29:01.239846 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a09916df-4975-4eb6-b187-01362be92c21 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1443 microversion: 2.1 time: 0.386908 Aug 07 19:29:01.242779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 181/379] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:00 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1443 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:01.276084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:01.277500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:01.291230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:01.292567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:01.294479 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:01.297502 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:01.298663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:01.299857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:01.529040 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:01.537586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-69120ead-66ae-40fa-a5af-21e292fbbe7a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1443 microversion: 2.1 time: 0.272208 Aug 07 19:29:01.538178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 199/380] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:01 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1443 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:02.257668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:02.258300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:02.265266 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:02.265755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:02.266195 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:02.266926 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:02.267550 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:02.267974 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:02.407169 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:02.415666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a76d5b2f-9296-4aca-b0da-48a7ad6bb71f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1708 microversion: 2.1 time: 0.162026 Aug 07 19:29:02.416452 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 182/381] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:02 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:03.438623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:03.439474 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:03.446494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:03.447680 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:03.448222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:03.448984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:03.449604 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:03.450131 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:03.603676 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:03.614730 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3b53577e-8f71-4230-a7b5-5af0d22b33cb tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1712 microversion: 2.1 time: 0.180506 Aug 07 19:29:03.630517 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 200/382] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:03 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1712 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:03.743004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-46009fcd-59c2-4b06-b414-cb7aacff0238 req-9f4c7c05-62e8-434c-ba68-45daf78c1415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6", "tag": "a441108c-e43e-4ecc-b113-5e6d2d30de08"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:03.753476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-46009fcd-59c2-4b06-b414-cb7aacff0238 req-9f4c7c05-62e8-434c-ba68-45daf78c1415 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:03.753950 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-46009fcd-59c2-4b06-b414-cb7aacff0238 req-9f4c7c05-62e8-434c-ba68-45daf78c1415 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:03.754559 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-46009fcd-59c2-4b06-b414-cb7aacff0238 req-9f4c7c05-62e8-434c-ba68-45daf78c1415 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:03.766895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-46009fcd-59c2-4b06-b414-cb7aacff0238 req-9f4c7c05-62e8-434c-ba68-45daf78c1415 service nova] Creating event network-changed:a441108c-e43e-4ecc-b113-5e6d2d30de08 for instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 on hv-cinder-85032 Aug 07 19:29:03.772373 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-46009fcd-59c2-4b06-b414-cb7aacff0238 req-9f4c7c05-62e8-434c-ba68-45daf78c1415 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033255 Aug 07 19:29:03.773382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 183/383] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:29:05.629696 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2057041731", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:05.688308 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] validate_networks() for None {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:29:05.975793 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:29:05.976272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:29:05.976741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:29:05.977132 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:29:05.977533 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:29:05.987053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:05.987524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:05.987951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:05.988697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:05.989678 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:05.989678 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:06.011155 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Getting quotas for project 494001e959da4570bf23768a0a47e603. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:29:06.011574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Getting quotas for user d170883bd1b040cfb39c485186734fb4 and project 494001e959da4570bf23768a0a47e603. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:29:06.031892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:29:06.034366 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:29:06.080815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1e36fbe9-3841-44ee-8221-98492f4428ab tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455044 Aug 07 19:29:06.081501 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 201/384] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:29:06.092995 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f5ab4566-1a69-4765-8c04-c5590c518187 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:06.094041 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f5ab4566-1a69-4765-8c04-c5590c518187 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:06.393099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f5ab4566-1a69-4765-8c04-c5590c518187 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:06.400669 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f5ab4566-1a69-4765-8c04-c5590c518187 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1215 microversion: 2.1 time: 0.311987 Aug 07 19:29:06.401266 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 184/385] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:06 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1215 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:07.424483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:07.425068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:07.432846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:07.433513 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:07.433933 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:07.434946 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:07.435622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:07.436159 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:07.502013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:07.510900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f17f98b-3a68-46bb-b59b-57dc45f817d7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1275 microversion: 2.1 time: 0.092685 Aug 07 19:29:07.511489 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 202/386] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:07 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:08.531883 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:08.532653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:08.542948 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:08.543568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:08.544223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:08.545713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:08.546844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:08.547336 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:08.687816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:08.695976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-72cf8663-7ed2-409c-b4f7-cb6d2fed43ae tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.168210 Aug 07 19:29:08.696590 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 185/387] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:08 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:09.074050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-2c61f50a-7b7d-42f4-be0d-5986f120cf0c req-4b095454-0ab9-4e3c-a139-b01336e1963c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d6edde-2706-4377-be9c-6eb4be8ed374", "tag": "0f44c6e4-b421-4e23-a368-a03a5bf70e88"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:09.085867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2c61f50a-7b7d-42f4-be0d-5986f120cf0c req-4b095454-0ab9-4e3c-a139-b01336e1963c service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:09.086773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2c61f50a-7b7d-42f4-be0d-5986f120cf0c req-4b095454-0ab9-4e3c-a139-b01336e1963c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:09.087501 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2c61f50a-7b7d-42f4-be0d-5986f120cf0c req-4b095454-0ab9-4e3c-a139-b01336e1963c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:09.100493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2c61f50a-7b7d-42f4-be0d-5986f120cf0c req-4b095454-0ab9-4e3c-a139-b01336e1963c service nova] Creating event network-changed:0f44c6e4-b421-4e23-a368-a03a5bf70e88 for instance 65d6edde-2706-4377-be9c-6eb4be8ed374 on hv-cinder-85032 Aug 07 19:29:09.105842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-2c61f50a-7b7d-42f4-be0d-5986f120cf0c req-4b095454-0ab9-4e3c-a139-b01336e1963c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036005 Aug 07 19:29:09.106456 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 203/388] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:09.717887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:09.718499 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:09.725211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:09.725943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:09.726352 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:09.727232 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:09.727678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:09.728121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:09.869814 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:09.877877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9e64007f-2c09-45cc-8985-164f6a6d0cb2 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.164706 Aug 07 19:29:09.878455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 186/389] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:09 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:10.900146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:10.900851 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:10.907242 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:10.907760 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:10.908295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:10.909000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:10.909450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:10.909864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:11.092575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:11.102133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-522e0bd8-320d-4044-b318-027d2b39115c tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.206681 Aug 07 19:29:11.111758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 204/390] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:10 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:12.124839 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:12.125450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:12.132561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:12.133049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:12.133481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:12.134175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:12.134623 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:12.135046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:12.279611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:12.287922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aef2f3b5-bc0d-4874-b2f1-420e3771b1c8 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.166924 Aug 07 19:29:12.288565 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 187/391] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:12 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:13.310279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:13.310840 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:13.313258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:13.318895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:13.319404 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:13.319827 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:13.320549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:13.320989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:13.321389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:13.457472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:13.459822 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:13.466727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-82b1423c-728b-49f6-b5e4-38017c5ea85a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.160644 Aug 07 19:29:13.467291 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 205/392] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:13 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:14.487246 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:14.487865 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:14.494987 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:14.495481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:14.495915 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:14.496675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:14.497142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:14.497572 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:14.632794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:14.640461 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2f9b905b-3176-4b0b-a791-b504992d96d4 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.157245 Aug 07 19:29:14.641036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 188/393] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:14 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:15.662395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:15.662961 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:15.670230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:15.670718 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:15.671130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:15.672194 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:15.672634 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:15.673044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:15.823951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:15.832635 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c5b4a395-6ece-497f-8d37-e035b66fba14 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.174842 Aug 07 19:29:15.833467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 206/394] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:15 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:15.906902 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8d9849eb-1387-49bc-a47e-35cf67bea55b req-aa564001-651a-463a-a16c-51bdbf081750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d6edde-2706-4377-be9c-6eb4be8ed374", "name": "network-vif-plugged", "status": "completed", "tag": "0f44c6e4-b421-4e23-a368-a03a5bf70e88"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:15.916878 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8d9849eb-1387-49bc-a47e-35cf67bea55b req-aa564001-651a-463a-a16c-51bdbf081750 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:15.917358 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8d9849eb-1387-49bc-a47e-35cf67bea55b req-aa564001-651a-463a-a16c-51bdbf081750 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:15.917783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8d9849eb-1387-49bc-a47e-35cf67bea55b req-aa564001-651a-463a-a16c-51bdbf081750 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:15.929665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8d9849eb-1387-49bc-a47e-35cf67bea55b req-aa564001-651a-463a-a16c-51bdbf081750 service nova] Creating event network-vif-plugged:0f44c6e4-b421-4e23-a368-a03a5bf70e88 for instance 65d6edde-2706-4377-be9c-6eb4be8ed374 on hv-cinder-85032 Aug 07 19:29:15.934888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8d9849eb-1387-49bc-a47e-35cf67bea55b req-aa564001-651a-463a-a16c-51bdbf081750 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031701 Aug 07 19:29:15.935494 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 189/395] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:16.854374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:16.854966 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:16.857366 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:16.858042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:16.864283 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:16.864770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:16.865201 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:16.865896 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:16.866343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:16.866768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:17.006111 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:17.016631 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1c9115c4-16d2-4632-90c7-dc08c4a19975 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1315 microversion: 2.1 time: 0.163956 Aug 07 19:29:17.016997 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 207/396] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:16 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:18.034037 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:18.038978 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:18.039690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:18.046770 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:18.047236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:18.047670 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:18.048459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:18.048963 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:18.049455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:18.188544 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:18.197254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-02c1e46e-82c1-489a-af03-f5bf4dbfdb8a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1465 microversion: 2.1 time: 0.164807 Aug 07 19:29:18.197843 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 190/397] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:18 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1465 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:18.242862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:18.243393 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:18.249937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:18.250414 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:18.250842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:18.251605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:18.252024 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:18.252490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:18.277474 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:29:18.365187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cc0f8ada-b1b8-4c38-b9c9-bd13e4e56251 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "DELETE /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 204 len: 0 microversion: 2.1 time: 0.125909 Aug 07 19:29:18.365776 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 208/398] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:29:18 2022] DELETE /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:29:18.374456 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:18.375065 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:18.381338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:18.381819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:18.382256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:18.382955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:18.383407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:18.383830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:18.521756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:18.529714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-65bea289-ae34-41ee-83a7-d0ccdee39849 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1471 microversion: 2.1 time: 0.159119 Aug 07 19:29:18.530204 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 191/399] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:18 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:29:19.553836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:19.554528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:19.561259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:19.561720 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:19.562175 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:19.562871 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:19.563321 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:19.563744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:19.707814 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:19.716070 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a3640fe5-d822-49c2-8741-ff9316031a94 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1471 microversion: 2.1 time: 0.166567 Aug 07 19:29:19.716645 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 209/400] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:19 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:20.737245 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:20.737820 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:20.745255 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:20.745741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:20.746215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:20.746979 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:20.747458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:20.747859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:20.880077 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:20.888123 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-118798b4-da4a-468a-a0e1-f376d82d672a tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1471 microversion: 2.1 time: 0.154718 Aug 07 19:29:20.888694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 192/401] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:20 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:21.433191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-e9fb93a6-86aa-4b98-b384-dcee2661e11f req-f08b479b-271e-4e9a-ab15-41354e77e23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d6edde-2706-4377-be9c-6eb4be8ed374", "name": "network-vif-deleted", "tag": "0f44c6e4-b421-4e23-a368-a03a5bf70e88"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:21.446685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e9fb93a6-86aa-4b98-b384-dcee2661e11f req-f08b479b-271e-4e9a-ab15-41354e77e23b service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:21.447416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e9fb93a6-86aa-4b98-b384-dcee2661e11f req-f08b479b-271e-4e9a-ab15-41354e77e23b service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:21.448152 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e9fb93a6-86aa-4b98-b384-dcee2661e11f req-f08b479b-271e-4e9a-ab15-41354e77e23b service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:21.464663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-e9fb93a6-86aa-4b98-b384-dcee2661e11f req-f08b479b-271e-4e9a-ab15-41354e77e23b service nova] Creating event network-vif-deleted:0f44c6e4-b421-4e23-a368-a03a5bf70e88 for instance 65d6edde-2706-4377-be9c-6eb4be8ed374 on hv-cinder-85032 Aug 07 19:29:21.469697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-e9fb93a6-86aa-4b98-b384-dcee2661e11f req-f08b479b-271e-4e9a-ab15-41354e77e23b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040307 Aug 07 19:29:21.470916 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 210/402] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:21.909643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:21.910140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:21.916808 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:21.917293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:21.917727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:21.918431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:21.918883 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:21.919302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:21.953501 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:21.953985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:21.954434 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:21.954893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lazy-loading 'fault' on Instance uuid 65d6edde-2706-4377-be9c-6eb4be8ed374 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:29:21.999701 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd170883bd1b040cfb39c485186734fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494001e959da4570bf23768a0a47e603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:22.003189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:22.008087 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-94a5190a-774a-402a-8a48-52400adefe61 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 200 len: 1305 microversion: 2.1 time: 0.102596 Aug 07 19:29:22.008999 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 193/403] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:21 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:23.030324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:23.031007 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] [instance: 65d6edde-2706-4377-be9c-6eb4be8ed374] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:23.038304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:23.038777 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:23.039201 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:23.039887 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:23.040365 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:23.040781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:23.054581 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] HTTP exception thrown: Instance 65d6edde-2706-4377-be9c-6eb4be8ed374 could not be found. Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Request method failure captured: Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 HTTP/1.1 Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BJ_S2jqZE3nomeePE5jrejaJY0KT5xhDaKmnYC-rJfsfV_q1UHyxEDZSdPn_DAFZan-9bC97hrPE0fKDA6zd3xhfIVJ0LRH9qCgirS3uAJdqdS-EsAHZZ0jTL5jcWr16BqX7_y-XVlQxHCBggxlekzv3g-QpnIsmLMDLfnBQeFzBpw Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 494001e959da4570bf23768a0a47e603 Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-1495702353 Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:29:23.056223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/494001e959da4570bf23768a0a47e603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_494001e959da4570bf23768a0a47e603", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/494001e959da4570bf23768a0a47e603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/494001e959da4570bf23768a0a47e603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-1495702353 Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 494001e959da4570bf23768a0a47e603 Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-1495702353 Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-1495702353-project Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: d170883bd1b040cfb39c485186734fb4 Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-1495702353-project Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 65d6edde-2706-4377-be9c-6eb4be8ed374 could not be found. Aug 07 19:29:23.057778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '65d6edde-2706-4377-be9c-6eb4be8ed374'} Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d6edde-2706-4377-be9c-6eb4be8ed374 could not be found. Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:29:23.058932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d6edde-2706-4377-be9c-6eb4be8ed374 could not be found. Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d6edde-2706-4377-be9c-6eb4be8ed374 could not be found. Aug 07 19:29:23.060954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:29:23.062233 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] Returning 404 to user: Instance 65d6edde-2706-4377-be9c-6eb4be8ed374 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:29:23.062233 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4930ab2c-c59d-46f2-a3eb-41d3bbb8b3e7 tempest-VolumesNegativeTest-1495702353 tempest-VolumesNegativeTest-1495702353-project] 10.222.0.17 "GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374" status: 404 len: 111 microversion: 2.1 time: 0.031554 Aug 07 19:29:23.062233 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 211/404] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:23 2022] GET /compute/v2.1/servers/65d6edde-2706-4377-be9c-6eb4be8ed374 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:29:26.277011 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:26.277629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:26.286192 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:26.286674 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:26.287106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:26.287816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:26.288311 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:26.288736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:26.314149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f240960b-153b-4505-a002-dde3c0c725e7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/ips" status: 200 len: 152 microversion: 2.20 time: 0.040892 Aug 07 19:29:26.314724 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 194/405] 10.222.0.17 () {60 vars in 1289 bytes} [Sun Aug 7 19:29:26 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:29:28.761779 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:28.762381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:28.769236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:28.769719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:28.770139 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:28.770823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:28.771267 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:28.771682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:28.795480 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lazy-loading 'flavor' on Instance uuid 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:29:28.979423 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-25e4069e-660e-4cc6-b1be-e1ce2c4c7961 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/action" status: 202 len: 0 microversion: 2.20 time: 0.221409 Aug 07 19:29:28.980016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 212/406] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Aug 7 19:29:28 2022] POST /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:29:28.988924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:28.989541 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:28.991945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=38 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:28.997252 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:28.997878 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:28.998514 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:28.999319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:28.999660 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:29.000183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:29.136793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:29.145603 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:29.147118 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:29.148382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-db0e2d7f-9c4a-4bbc-bf2d-56ef26d9a4ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.163399 Aug 07 19:29:29.148965 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 195/407] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:28 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:30.172570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:30.173249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:30.183392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:30.183879 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:30.184344 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:30.185041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:30.185541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:30.185963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:30.327518 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:30.337531 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:30.339061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:30.340278 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c6665955-b025-4a0f-b4ea-3ce166b1df50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.172963 Aug 07 19:29:30.340842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 213/408] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:30 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:31.364174 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:31.364826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:31.371583 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:31.372061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:31.372686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:31.373399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:31.373859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:31.374283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:31.508148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:31.516565 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:31.518184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:31.519358 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8efbd9d4-5081-45b0-8a6c-69c369ebba5d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.159480 Aug 07 19:29:31.519929 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 196/409] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:31 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:32.542614 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:32.543238 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:32.550592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:32.551055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:32.551495 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:32.552222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:32.552670 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:32.553082 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:32.694579 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:32.703681 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:32.705378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:32.706652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f3ab787d-031f-49ea-aa4e-7504eff9f0cf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.167978 Aug 07 19:29:32.707224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 214/410] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:32 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:33.730124 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:33.730720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:33.737765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:33.738251 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:33.738703 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:33.739402 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:33.739857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:33.740312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:33.877242 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:33.885719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:33.887119 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:33.888380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-544aa311-4236-4894-9f7e-3a68b85cbe0b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.162314 Aug 07 19:29:33.888880 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 197/411] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:33 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:34.912459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:34.913020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:34.919868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:34.920378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:34.920807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:34.921851 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:34.922300 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:34.922717 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:35.057483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:35.066310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:35.067825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:35.069005 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-245c986e-c1ea-4dc6-9435-5b80861229db tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.160573 Aug 07 19:29:35.069571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 215/412] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:34 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:36.092143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:36.092704 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:36.099700 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:36.100223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:36.100662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:36.101835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:36.102300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:36.102728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:36.240351 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:36.249001 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:36.250510 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:36.251736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8032e676-9c7d-4383-ba92-861a1b5e5caf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.163612 Aug 07 19:29:36.252328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 198/413] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:36 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:37.275164 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:37.275778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:37.282801 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:37.283295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:37.283732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:37.284467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:37.284915 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:37.285340 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:37.422150 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:37.430777 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:37.432336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:37.433520 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-590ab89a-2bc0-4a4c-a4e7-d112c0678197 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.162544 Aug 07 19:29:37.434097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 216/414] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:37 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:38.457531 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:38.458159 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:38.465191 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:38.465678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:38.466126 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:38.466826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:38.467278 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:38.467701 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:38.606063 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:38.614536 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:38.616039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:38.617291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-df913320-9124-41b7-9d59-229f3286f925 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.163881 Aug 07 19:29:38.617865 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 199/415] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:38 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:39.642023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:39.642718 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:39.649958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:39.650440 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:39.650873 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:39.651597 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:39.652062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:39.652507 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:39.786965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:39.795514 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:39.797409 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:39.798712 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0149b5d5-bb6e-484c-ba3e-84deb281870b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.160673 Aug 07 19:29:39.799265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 217/416] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:39 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:40.822142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:40.822730 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:40.829322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:40.829841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:40.830268 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:40.830954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:40.831396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:40.831811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:40.970869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:40.979143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:40.980679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:40.981836 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dc0dae8a-4e94-405d-bdef-3adb4a3e53d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.163772 Aug 07 19:29:40.982366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 200/417] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:40 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:42.005187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:42.005791 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:42.012700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:42.013181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:42.013611 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:42.014304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:42.014741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:42.015165 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:42.150867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:42.159291 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:42.160844 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:42.161999 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-03726b8b-f190-424a-90d7-e1881d1a4ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.160905 Aug 07 19:29:42.162574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 218/418] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:41 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:43.185877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:43.186501 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:43.193644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:43.194130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:43.194565 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:43.195261 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:43.195715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:43.196184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:43.328923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:43.337615 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:43.339110 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:43.340326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-71505c0b-8b02-4114-a5a3-5e05b0cccbb1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.158485 Aug 07 19:29:43.340891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 201/419] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:43 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:44.363765 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:44.364390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:44.366729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:44.372266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:44.372737 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:44.373160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:44.373843 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:44.374284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:44.374697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:44.514175 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:44.522650 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:44.524163 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:44.525300 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-130893c9-74fe-45e2-8a73-201d1de28cc8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.165689 Aug 07 19:29:44.525852 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 219/420] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:44 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:45.549179 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:45.549783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:45.556632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:45.557113 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:45.557552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:45.558249 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:45.558701 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:45.559132 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:45.691622 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:45.700022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:45.701567 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:45.702727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7cd8a5f3-608a-48f9-9159-ec9b7a2fef86 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.157895 Aug 07 19:29:45.703290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 202/421] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:45 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:45.963752 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:45.964374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:45.971249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:45.971727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:45.972210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:45.972904 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:45.973352 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:45.973774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:45.976528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:45.999481 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4af06ff9-2089-4eb9-94dd-ec69bb5b8faf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc/ips" status: 200 len: 149 microversion: 2.1 time: 0.039772 Aug 07 19:29:46.000058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 220/422] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:29:45 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:46.012695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d97db7b-0978-4e0c-b89d-876901a5fcd0"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:46.015171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:46.021442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.021922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.022359 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.023056 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.023521 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.023948 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.108008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Invalid volume: volume 1d97db7b-0978-4e0c-b89d-876901a5fcd0 is already attached to instances: ab31f7bc-2dfc-4b03-8e02-37f4ac156634 Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc/os-volume_attachments HTTP/1.1 Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 74 Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:29:46.109844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "1d97db7b-0978-4e0c-b89d-876901a5fcd0"}} Aug 07 19:29:46.111469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Invalid volume: volume 1d97db7b-0978-4e0c-b89d-876901a5fcd0 is already attached to instances: ab31f7bc-2dfc-4b03-8e02-37f4ac156634 Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'server_id': 'd0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc', 'body': {'volumeAttachment': {'volumeId': '1d97db7b-0978-4e0c-b89d-876901a5fcd0'}}} Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1d97db7b-0978-4e0c-b89d-876901a5fcd0 is already attached to instances: ab31f7bc-2dfc-4b03-8e02-37f4ac156634 Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:46.112679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1d97db7b-0978-4e0c-b89d-876901a5fcd0 is already attached to instances: ab31f7bc-2dfc-4b03-8e02-37f4ac156634 Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:46.114300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1d97db7b-0978-4e0c-b89d-876901a5fcd0 is already attached to instances: ab31f7bc-2dfc-4b03-8e02-37f4ac156634 Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 400 to user: Invalid volume: volume 1d97db7b-0978-4e0c-b89d-876901a5fcd0 is already attached to instances: ab31f7bc-2dfc-4b03-8e02-37f4ac156634 {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-117b605c-744e-4742-84d3-ccf6b0ee5a9b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102709 Aug 07 19:29:46.115710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 203/423] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:29:46 2022] POST /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:29:46.122258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:46.122871 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:46.131409 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.131894 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.132445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.133143 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.133590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.134011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.158915 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:29:46.237634 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d57f82f8-697f-4d9a-9c20-77f90380c50c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 204 len: 0 microversion: 2.1 time: 0.119183 Aug 07 19:29:46.238376 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 221/424] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:29:46 2022] DELETE /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:29:46.248894 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:46.249485 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:46.256124 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.256609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.257055 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.257772 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.258226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.258650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.401044 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:46.409030 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9000863-deec-4f35-9ff8-8126f13c0eb4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1681 microversion: 2.1 time: 0.165615 Aug 07 19:29:46.409597 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 204/425] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:46 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:46.726274 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:46.726998 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:46.733384 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.733864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.734295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.734973 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:46.735426 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:46.735840 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:46.872703 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:46.881111 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:46.882589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:46.883748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6b09d3e2-be9e-4d6d-aa8a-ecce00cad594 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.161828 Aug 07 19:29:46.884397 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 222/426] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:46 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:47.432153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:47.432749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:47.440056 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:47.440541 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:47.441005 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:47.441701 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:47.442155 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:47.442585 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:47.577494 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:47.585396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c4b6c967-3cb9-4f77-a452-99f3a0089b4d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1681 microversion: 2.1 time: 0.157367 Aug 07 19:29:47.585996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 205/427] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:47 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:47.906837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:47.907408 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:47.914406 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:47.914888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:47.915322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:47.916035 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:47.916529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:47.916950 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:48.058404 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:48.066808 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:48.068385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:48.069580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2f7cb8d-2671-4c6c-9668-f475f4a367ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.166693 Aug 07 19:29:48.070145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 223/428] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:47 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:48.606828 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:48.607421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:48.614481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:48.614890 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:48.615327 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:48.616068 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:48.616621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:48.616955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:48.751762 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:48.759539 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdbc8cb8-db54-4651-abda-0bd5946709c4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1681 microversion: 2.1 time: 0.156596 Aug 07 19:29:48.760137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 206/429] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:48 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:49.093038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:49.093705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:49.100773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:49.101290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:49.101675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:49.102352 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:49.102810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:49.103201 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:49.239029 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1c949b6f-d649-41d9-a1b9-c76de0d380f0 req-d065b6f5-595b-4843-9ed4-2b6d0d944272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc", "name": "network-vif-deleted", "tag": "ac8f2ac6-a711-483f-af50-455a4c94eb35"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:49.249114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1c949b6f-d649-41d9-a1b9-c76de0d380f0 req-d065b6f5-595b-4843-9ed4-2b6d0d944272 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:49.250017 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1c949b6f-d649-41d9-a1b9-c76de0d380f0 req-d065b6f5-595b-4843-9ed4-2b6d0d944272 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:49.250672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1c949b6f-d649-41d9-a1b9-c76de0d380f0 req-d065b6f5-595b-4843-9ed4-2b6d0d944272 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:49.265372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1c949b6f-d649-41d9-a1b9-c76de0d380f0 req-d065b6f5-595b-4843-9ed4-2b6d0d944272 service nova] Creating event network-vif-deleted:ac8f2ac6-a711-483f-af50-455a4c94eb35 for instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc on hv-cinder-85032 Aug 07 19:29:49.271542 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1c949b6f-d649-41d9-a1b9-c76de0d380f0 req-d065b6f5-595b-4843-9ed4-2b6d0d944272 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036320 Aug 07 19:29:49.271713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:49.272523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 207/430] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:29:49.283757 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:49.285298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:49.286865 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7f964261-0712-48c9-8f26-5bb3023d3486 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.197706 Aug 07 19:29:49.287929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 224/431] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:49 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:49.781166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:49.781948 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:49.789579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:49.790111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:49.790543 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:49.791237 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:49.791682 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:49.792168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:49.824885 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:49.825361 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:49.825786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:49.826467 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lazy-loading 'fault' on Instance uuid d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:29:49.869625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:49.877588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c5bfe6b3-6d6d-44c3-bb9e-adc7f0ce61c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 200 len: 1332 microversion: 2.1 time: 0.100726 Aug 07 19:29:49.878167 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 208/432] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:49 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:50.310470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:50.311078 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:50.318430 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:50.318899 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:50.319318 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:50.320137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:50.320767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:50.321183 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:50.477234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:50.487431 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:50.488995 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:50.490191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-81b2400d-323a-4ca8-bd1e-f41661faa70b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1744 microversion: 2.20 time: 0.183626 Aug 07 19:29:50.490761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 225/433] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:50 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:50.900333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:50.901035 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:50.908736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:50.909409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:50.909840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:50.910534 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:50.910984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:50.911406 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:50.929451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc HTTP/1.1 Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:29:50.931121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:29:50.932645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc'} Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:29:50.934171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:29:50.936391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:50.939027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:29:50.939027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0712311f-f9da-4ac0-9f9d-81b6c2f1e979 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 404 len: 111 microversion: 2.1 time: 0.037329 Aug 07 19:29:50.939027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 209/434] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:50 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:29:50.943196 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ed194d60-c432-484b-8aa2-d67211d9d039 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '.version_select at 0x7fd476e31700>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:50.967648 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ed194d60-c432-484b-8aa2-d67211d9d039 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312898459" status: 202 len: 0 microversion: 2.1 time: 0.029095 Aug 07 19:29:50.968444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 226/435] 10.222.0.17 () {58 vars in 1221 bytes} [Sun Aug 7 19:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312898459 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:29:51.518116 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:51.518886 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:51.531673 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:51.532195 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:51.532630 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:51.533371 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:51.533825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:51.534292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:51.674613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:51.683478 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:51.685015 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:51.686197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-446f4e66-c5e3-4850-8e30-658cf7829c69 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1744 microversion: 2.20 time: 0.172224 Aug 07 19:29:51.686747 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 210/436] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:51 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:51.691805 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:51.692612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:51.699422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:51.699899 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:51.700370 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:51.701065 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:51.701514 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:51.701929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:51.836586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lazy-loading 'services' on Instance uuid ab31f7bc-2dfc-4b03-8e02-37f4ac156634 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:29:51.953863 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5e831091-7f98-4f37-b218-fd72096a02b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments/1d97db7b-0978-4e0c-b89d-876901a5fcd0" status: 202 len: 0 microversion: 2.1 time: 0.266510 Aug 07 19:29:51.954683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 227/437] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:29:51 2022] DELETE /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments/1d97db7b-0978-4e0c-b89d-876901a5fcd0 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 19:29:51.963150 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:51.965441 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:51.972253 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:51.973258 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:51.973533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:51.974227 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:51.974666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:51.975272 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:52.003727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:52.016493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-026e1197-1268-494f-a9e6-1734c1ddc9ea tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057184 Aug 07 19:29:52.017570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 211/438] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:29:51 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:52.714134 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:52.715359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:52.724463 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:52.725130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:52.727145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:52.728254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:52.728938 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:52.729572 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:52.886440 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:52.895974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:52.897698 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:52.899043 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aa98632f-085b-4d88-9999-6c4444a06bc1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.193578 Aug 07 19:29:52.900036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 228/439] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:52 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:53.029149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:53.031421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:53.038277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:53.038785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:53.039297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:53.039918 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:53.040887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:53.040887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:53.075942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8bead3be-d7e9-427d-86d5-5ae1096c3fd2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050789 Aug 07 19:29:53.076658 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 212/440] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:29:53 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:53.356140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:53.356692 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:53.364149 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:53.364697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:53.365178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:53.366017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:53.366702 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:53.367127 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:53.471038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lazy-loading 'services' on Instance uuid 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:29:53.568976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2a05ea9-4ac1-4c2c-8d73-3f7be27a7e52 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-volume_attachments/0d9c79e5-faef-4eaa-ac83-d4f27584e5d4" status: 202 len: 0 microversion: 2.1 time: 0.217382 Aug 07 19:29:53.569753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 229/441] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:29:53 2022] DELETE /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-volume_attachments/0d9c79e5-faef-4eaa-ac83-d4f27584e5d4 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:29:53.923152 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:53.923751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:53.930311 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:53.931108 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:53.931521 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:53.932421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:53.933028 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:53.933608 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.099146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:54.102938 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:54.111225 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:54.111862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:54.112895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.113964 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:54.114761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:54.115264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.155696 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eed9ed1a-8381-46d7-b646-030a8bbfc666 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060677 Aug 07 19:29:54.161963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 230/442] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:29:54 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:29:54.168760 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-92294665-f9da-4a7e-85d2-8705c7bea14f req-79785227-416e-4c18-8f63-2d5dd8d68781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20345500-7cc0-4cd4-9c7a-35fc42ba4a32", "name": "network-vif-plugged", "status": "completed", "tag": "a274bf48-e334-42be-b1f2-d9db7f626a04"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:54.189965 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:54.192002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-92294665-f9da-4a7e-85d2-8705c7bea14f req-79785227-416e-4c18-8f63-2d5dd8d68781 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:54.192616 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-92294665-f9da-4a7e-85d2-8705c7bea14f req-79785227-416e-4c18-8f63-2d5dd8d68781 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:54.193827 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-92294665-f9da-4a7e-85d2-8705c7bea14f req-79785227-416e-4c18-8f63-2d5dd8d68781 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.199174 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:54.200766 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:54.202169 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-28486e7b-987d-4fb6-b38b-994931f19ad7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.283232 Aug 07 19:29:54.202539 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 213/443] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:53 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:54.223445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-92294665-f9da-4a7e-85d2-8705c7bea14f req-79785227-416e-4c18-8f63-2d5dd8d68781 service nova] Creating event network-vif-plugged:a274bf48-e334-42be-b1f2-d9db7f626a04 for instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 on hv-cinder-85032 Aug 07 19:29:54.241512 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-92294665-f9da-4a7e-85d2-8705c7bea14f req-79785227-416e-4c18-8f63-2d5dd8d68781 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077763 Aug 07 19:29:54.244842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 231/444] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:54.248452 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:54.249216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:54.256702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:54.257465 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:54.258049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.258951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:54.259575 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:54.260243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.289347 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:29:54.410839 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-37f6a92e-52bf-4be8-88e4-3427b760f5b5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 204 len: 0 microversion: 2.1 time: 0.165779 Aug 07 19:29:54.412018 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 214/445] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:29:54 2022] DELETE /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:29:54.421342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:54.422403 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:54.432931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:54.435757 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:54.436424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.437346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:54.437963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:54.438538 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:54.617987 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:54.627685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f95f6a23-9cd0-46fe-926a-3cdb766b25d9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1682 microversion: 2.1 time: 0.210793 Aug 07 19:29:54.628880 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 232/446] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:54 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:55.230797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:55.231704 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:55.239409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:55.240039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:55.240518 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:55.241471 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:55.242098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:55.242680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:55.393004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:55.401819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:55.403633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:55.404849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d157793-dfa1-4211-ac05-f1592085b8c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.178855 Aug 07 19:29:55.405603 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 215/447] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:55 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:55.662880 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:55.663644 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:55.671559 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:55.672037 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:55.672494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:55.673189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:55.673619 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:55.674700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:55.854601 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e8d55808-fb91-43b7-a128-13278e656758 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:55.859691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:55.869240 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-41992688-61e0-4474-9240-041e2511a665 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1682 microversion: 2.1 time: 0.210253 Aug 07 19:29:55.871869 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 233/448] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:55 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:55.882120 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8d55808-fb91-43b7-a128-13278e656758 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:55.884436 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8d55808-fb91-43b7-a128-13278e656758 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:55.885052 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8d55808-fb91-43b7-a128-13278e656758 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:55.922925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e8d55808-fb91-43b7-a128-13278e656758 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Going to try to stop instance {{(pid=117832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 19:29:55.985239 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e8d55808-fb91-43b7-a128-13278e656758 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.135829 Aug 07 19:29:55.985851 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 216/449] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:29:55 2022] POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:29:55.994540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:55.995255 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:56.002441 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.002943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.003400 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:56.004197 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.004859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.006017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:56.085899 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e451bdfb-0951-422b-b743-d50619cc299a"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:56.089134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:56.101471 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.102727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.103720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:56.105279 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.106379 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.107402 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:56.277394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:56.287377 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c59d52b9-90a8-4b22-b546-be0e8a6da3a0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.296619 Aug 07 19:29:56.300072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 234/450] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:55 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:56.433811 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:56.434500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:56.443958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.448178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.460308 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:56.461616 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.462345 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.463236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:56.672811 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:56.677753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:56.696382 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:56.700280 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:56.701600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-49ba4c46-71ea-45d6-93e9-6f8158d1af8c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.273872 Aug 07 19:29:56.716231 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 235/451] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:56 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:29:56.800576 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad55700d-9265-47bd-8de8-86ccff344ab0 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724703 Aug 07 19:29:56.807017 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 217/452] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:29:56 2022] POST /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:56.890627 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:56.891451 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:56.902140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.902893 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.903546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:56.904546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:56.905215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:56.905848 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:57.104410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:57.117459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-35471276-5b36-4e86-aef4-2ee76740295e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1682 microversion: 2.1 time: 0.230294 Aug 07 19:29:57.129119 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 236/453] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:56 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:57.311260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:57.313300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:57.321155 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:57.322581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:57.323489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:57.324466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:57.325117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:57.325732 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:57.489287 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:57.498261 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b1728bac-4135-44ed-a729-48148dd7c2c5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.191413 Aug 07 19:29:57.512555 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 218/454] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:57 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:57.682383 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ed6d5a8a-0f13-4829-a5a6-20464ac6346e req-a8a1f9cf-8c16-456d-b2ac-1203b775df3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab31f7bc-2dfc-4b03-8e02-37f4ac156634", "name": "network-vif-deleted", "tag": "ec5e8929-117c-45be-bbd1-05e5980f7c7a"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:29:57.696862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ed6d5a8a-0f13-4829-a5a6-20464ac6346e req-a8a1f9cf-8c16-456d-b2ac-1203b775df3f service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:57.697630 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ed6d5a8a-0f13-4829-a5a6-20464ac6346e req-a8a1f9cf-8c16-456d-b2ac-1203b775df3f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:57.698254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ed6d5a8a-0f13-4829-a5a6-20464ac6346e req-a8a1f9cf-8c16-456d-b2ac-1203b775df3f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:57.721918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ed6d5a8a-0f13-4829-a5a6-20464ac6346e req-a8a1f9cf-8c16-456d-b2ac-1203b775df3f service nova] Creating event network-vif-deleted:ec5e8929-117c-45be-bbd1-05e5980f7c7a for instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 on hv-cinder-85032 Aug 07 19:29:57.732205 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:57.732466 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ed6d5a8a-0f13-4829-a5a6-20464ac6346e req-a8a1f9cf-8c16-456d-b2ac-1203b775df3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054044 Aug 07 19:29:57.733238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:57.733562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 237/455] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:29:57.750582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:57.751417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:57.752097 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:57.753049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:57.753768 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:57.754401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:58.060643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:58.071134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:58.073927 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:58.075129 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-09be762c-1b94-4a07-883c-ea26ece9c62a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.349608 Aug 07 19:29:58.089553 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 219/456] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:57 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:29:58.142256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:58.143025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:58.152733 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:58.153135 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:58.156882 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:58.157646 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:58.158303 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:58.160418 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:58.221135 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:58.221948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:58.222405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:58.222849 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lazy-loading 'fault' on Instance uuid ab31f7bc-2dfc-4b03-8e02-37f4ac156634 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:29:58.278237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:58.292017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-416f834c-a207-49cc-90f4-dcc39bfba491 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 200 len: 1332 microversion: 2.1 time: 0.154323 Aug 07 19:29:58.300605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 238/457] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:58 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 1332 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:58.526045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:58.527862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:58.542652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:58.544479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:58.545600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:58.547710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:58.548780 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:58.550219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:58.770737 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:58.782991 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e3de2142-7a61-4bc7-a329-926ba514655b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.264801 Aug 07 19:29:58.783787 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 220/458] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:58 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:29:59.098943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:59.100374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:59.109050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:59.110002 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:59.110658 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:59.111599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:59.112405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:59.113114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:59.294071 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:59.305171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:59.306714 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:59.308269 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-798ca5b9-bd7c-4587-ba67-a9820cc73af6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.213432 Aug 07 19:29:59.309121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 239/459] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:29:59 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:29:59.325305 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:59.325932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:59.328061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:59.334431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:59.334931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:59.335371 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:59.336122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:59.336590 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:59.337002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:59.352849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 HTTP/1.1 Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:29:59.354537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:29:59.355776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ab31f7bc-2dfc-4b03-8e02-37f4ac156634'} Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:29:59.356526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:29:59.357954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:29:59.358975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:29:59.358975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-53b04d84-646b-40fb-a4ba-420c8598fd18 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 404 len: 111 microversion: 2.1 time: 0.034550 Aug 07 19:29:59.358975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 221/460] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:59 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:29:59.366041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-75980601-88ec-403d-8129-b0894224cf5d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '.version_select at 0x7fd476ce80d0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:59.388990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-75980601-88ec-403d-8129-b0894224cf5d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221461059" status: 202 len: 0 microversion: 2.1 time: 0.026885 Aug 07 19:29:59.391369 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 240/461] 10.222.0.17 () {58 vars in 1221 bytes} [Sun Aug 7 19:29:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221461059 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:29:59.807401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:29:59.808074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:29:59.824827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:59.825666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:59.826344 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:59.827306 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:29:59.827985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:29:59.828653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:29:59.980016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:29:59.988989 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6b708c84-aa00-4c1b-94bd-c13c8b18fb5c tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.185599 Aug 07 19:29:59.989976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 222/462] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:29:59 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:00.197735 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a149bcc0-9b2e-427e-ab07-4f473dc6c0e1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: .version_select at 0x7fd476c8f5e0>, body: {"keypair": {"name": "tempest-keypair-133531702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVpY5yV1vJWvwTu6oPbu2QCnzhmXxNB4orFSuesjTHGDJSIz3a0W7vkMtkSbXZ53VLc7jZE5r28M0L1xhdxBgA4sDDBq3xDIO+6fdtO3+lvr1LYb+iaIYIqoIcNMsfqZw=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:00.221405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-a149bcc0-9b2e-427e-ab07-4f473dc6c0e1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:30:00.225690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-a149bcc0-9b2e-427e-ab07-4f473dc6c0e1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:30:00.251510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a149bcc0-9b2e-427e-ab07-4f473dc6c0e1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057527 Aug 07 19:30:00.252147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 241/463] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:30:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:00.331922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:00.332541 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:00.351676 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:00.352243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:00.352771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:00.353595 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:00.354058 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:00.354493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:00.515625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:00.524507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:00.526517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:00.527875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9f4bf1a1-05f6-4826-a7fb-4eeb1687fcfb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.200889 Aug 07 19:30:00.544095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 223/464] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:00 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:01.011275 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:01.012214 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:01.023979 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:01.024771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:01.025583 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:01.026806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:01.027515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:01.028176 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:01.261552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:01.271548 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4b9cce61-7ddc-4427-94f0-ee7e6d8e8823 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.263466 Aug 07 19:30:01.276251 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 242/465] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:01 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:01.551362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:01.552250 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:01.560073 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:01.560561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:01.561269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:01.562220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:01.562739 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:01.563392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:01.801702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:01.814693 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:01.818275 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:01.826026 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b71d051b-9430-4e04-8f3b-7765764a2936 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.274913 Aug 07 19:30:01.828141 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 224/466] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:01 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:02.306177 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:02.307664 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:02.326586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:02.327075 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:02.327505 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:02.332160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:02.333112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:02.335436 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:02.403615 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-931890577", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc78dd60-2af8-48f0-9dbc-66b27c087d3d"}], "security_groups": [{"name": "tempest-securitygroup--37830178"}], "key_name": "tempest-keypair-133531702", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:02.532109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:02.545359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-54b51e83-abfa-4a9a-a894-c2a3716575e7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.251857 Aug 07 19:30:02.547409 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 243/467] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:02 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:02.566856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] validate_networks() for [('fc78dd60-2af8-48f0-9dbc-66b27c087d3d', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:30:02.860540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:02.861580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:02.868395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:02.869274 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:02.870395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:02.871453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:02.872191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:02.872852 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:03.137008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:03.151089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:03.153264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:03.154829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5e924fac-9009-41b4-956d-47642d9dd327 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1739 microversion: 2.20 time: 0.298900 Aug 07 19:30:03.156770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 244/468] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:02 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:03.177907 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:30:03.178542 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:30:03.179199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:30:03.179781 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:30:03.180234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:30:03.189841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:03.190801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:03.191471 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:03.192464 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:03.193143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:03.193788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:03.203365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:03.215433 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:30:03.220622 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:30:03.232368 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:30:03.234933 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:30:03.305672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-db1d8b4b-8d3c-4639-9c33-6fec80eed098 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.906829 Aug 07 19:30:03.306647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 225/469] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:30:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:30:03.318362 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fd59143a-11a1-4e62-ae13-42e6264e536b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:03.319017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fd59143a-11a1-4e62-ae13-42e6264e536b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:03.432023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fd59143a-11a1-4e62-ae13-42e6264e536b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:03.439161 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fd59143a-11a1-4e62-ae13-42e6264e536b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1240 microversion: 2.1 time: 0.125162 Aug 07 19:30:03.439740 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 245/470] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:03 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:03.572654 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:03.573257 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:03.581380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:03.581868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:03.582296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:03.583115 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:03.583445 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:03.583940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:03.752535 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:03.760247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4025503a-7ba7-422c-928f-6db807ff4110 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.192257 Aug 07 19:30:03.760834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 226/471] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:03 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:04.179417 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:04.180191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:04.186944 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.187532 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.188081 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.188809 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.189259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.189685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.330224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:04.338945 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:04.340469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:04.341866 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aef721a2-8582-4274-8d2f-bea9db8e4ad2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1721 microversion: 2.20 time: 0.166834 Aug 07 19:30:04.342597 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 246/472] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:04 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:04.460181 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:04.460791 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:04.466975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.467450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.467880 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.468669 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.469113 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.469534 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.507760 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:04.510290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:04.516973 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.517459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.517887 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.518705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.519198 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.519573 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.531516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:04.539395 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c8b1fe04-225d-4f6a-8de7-24842453aeae tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1292 microversion: 2.1 time: 0.083225 Aug 07 19:30:04.539963 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 227/473] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:04 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:04.544224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lazy-loading 'flavor' on Instance uuid d24bc3ee-0e1c-4532-8859-2c6e8a675b3b {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:30:04.675598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-54d3a5f3-01c8-4449-a59f-d2240ad00e91 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/action" status: 200 len: 32 microversion: 2.1 time: 0.171692 Aug 07 19:30:04.676276 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 247/474] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:30:04 2022] POST /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:30:04.686048 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:04.686743 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:04.693940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.694436 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.694869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.695580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.696076 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.696647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.783121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:04.784353 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:04.792455 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.793545 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.794208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.795339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:04.796372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:04.796892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:04.911047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:04.921302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdb4e018-2efe-4fc6-94ba-a655aa2ba479 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.238868 Aug 07 19:30:04.922638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 228/475] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:04 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:04.999736 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:05.008090 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cd7adae3-4d16-4045-a0ce-5d9367638000 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.230556 Aug 07 19:30:05.019710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 248/476] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:04 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:05.365852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:05.366480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:05.373834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:05.374299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:05.374738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:05.375837 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:05.376335 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:05.376768 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:05.521142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:05.530025 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:05.531613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:05.532863 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a1954a9-834e-4398-b643-cf05980782ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1721 microversion: 2.20 time: 0.171654 Aug 07 19:30:05.533459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 229/477] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:05 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:05.562772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:05.563378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:05.570322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:05.570805 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:05.571303 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:05.571934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:05.572418 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:05.572968 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:05.635855 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:05.644574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9d0f77d0-be10-4f1c-b536-412e73f18b37 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1298 microversion: 2.1 time: 0.085343 Aug 07 19:30:05.645203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 249/478] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:05 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:05.943019 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:05.943824 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:05.950570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:05.951093 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:05.951533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:05.952325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:05.952729 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:05.953349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:06.031518 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:06.032177 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:06.038625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:06.039114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:06.040894 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:06.041640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:06.042141 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:06.042541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:06.111407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:06.126668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-85b25a29-3f07-43e3-9362-110ff5d57745 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.187516 Aug 07 19:30:06.129663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 230/479] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:05 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:06.230410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:06.238581 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eb6a36e0-6b14-4eda-8750-d2b6f2962e66 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.211516 Aug 07 19:30:06.239166 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 250/480] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:06 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:06.557269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:06.557820 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:06.564630 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:06.565118 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:06.565550 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:06.566256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:06.566708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:06.567106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:06.670466 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:06.672026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:06.682592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:06.683425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:06.684209 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:06.685281 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:06.686088 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:06.686834 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:06.733391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:06.742222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:06.743739 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:06.744943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0fe549cf-b3d9-4af6-9855-24940b496219 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1721 microversion: 2.20 time: 0.191846 Aug 07 19:30:06.745503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 231/481] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:06 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:06.849135 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:06.856995 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e0483ce4-e4c3-4add-ad77-49f44f04b4f3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.193710 Aug 07 19:30:06.857557 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 251/482] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:06 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:07.148947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:07.149508 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:07.156591 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.157098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.157524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.158203 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.158657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.159077 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.260007 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:07.260929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:07.270094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.270901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.271874 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.272949 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.273654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.274372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.302877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:07.324675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8dc8c53a-998b-47c5-8802-dc09b48bf54e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.179650 Aug 07 19:30:07.325270 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 232/483] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:07 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:07.463718 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:07.472172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5851d1c7-3850-46ee-8067-082638626cee tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1676 microversion: 2.1 time: 0.215976 Aug 07 19:30:07.472766 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 252/484] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:07 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:07.766813 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:07.767420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:07.773450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.774054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.774503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.775193 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.775637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.776095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.817919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-664e7983-bc23-4e02-a3dc-a3ee4434bc36 req-e26c06b7-1d31-47fc-ade3-8c4c3e3caf63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0", "tag": "23b8cc87-f2b3-49cd-a6d4-33f1831666b8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:07.832255 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-664e7983-bc23-4e02-a3dc-a3ee4434bc36 req-e26c06b7-1d31-47fc-ade3-8c4c3e3caf63 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.832849 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-664e7983-bc23-4e02-a3dc-a3ee4434bc36 req-e26c06b7-1d31-47fc-ade3-8c4c3e3caf63 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.833516 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-664e7983-bc23-4e02-a3dc-a3ee4434bc36 req-e26c06b7-1d31-47fc-ade3-8c4c3e3caf63 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.848097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-664e7983-bc23-4e02-a3dc-a3ee4434bc36 req-e26c06b7-1d31-47fc-ade3-8c4c3e3caf63 service nova] Creating event network-changed:23b8cc87-f2b3-49cd-a6d4-33f1831666b8 for instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 on hv-cinder-85032 Aug 07 19:30:07.854035 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-664e7983-bc23-4e02-a3dc-a3ee4434bc36 req-e26c06b7-1d31-47fc-ade3-8c4c3e3caf63 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039598 Aug 07 19:30:07.854774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 253/485] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:07.878419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:07.879147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:07.886958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.887472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.887904 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.888858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:07.889470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:07.889892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:07.905602 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:07.932133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:07.949152 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:07.960415 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:07.961868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3fdc0814-c8c8-4dd4-bb3c-c3231fe2cd73 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1724 microversion: 2.20 time: 0.198907 Aug 07 19:30:07.963746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 233/486] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:07 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:07.988004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd312e14-9e61-4f78-967d-8791fe3a1fc6"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:07.990755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:08.003353 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.003907 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.004919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.019838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.020424 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.020848 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.104077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:08.113346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9029af5e-8771-4a72-ab41-8b2c0155276c tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.239109 Aug 07 19:30:08.114309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 254/487] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:07 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:08.120019 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9ecf8f39-c8db-4075-bfbe-05b00f754139 req-f8a55dda-8bb3-420d-92cb-e3884858a2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20345500-7cc0-4cd4-9c7a-35fc42ba4a32", "name": "network-vif-unplugged", "status": "completed", "tag": "a274bf48-e334-42be-b1f2-d9db7f626a04"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:08.131191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ecf8f39-c8db-4075-bfbe-05b00f754139 req-f8a55dda-8bb3-420d-92cb-e3884858a2a7 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.131670 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ecf8f39-c8db-4075-bfbe-05b00f754139 req-f8a55dda-8bb3-420d-92cb-e3884858a2a7 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.133068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ecf8f39-c8db-4075-bfbe-05b00f754139 req-f8a55dda-8bb3-420d-92cb-e3884858a2a7 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.145423 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.compute.server_external_events [req-9ecf8f39-c8db-4075-bfbe-05b00f754139 req-f8a55dda-8bb3-420d-92cb-e3884858a2a7 service nova] Unable to find a host for instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32. Dropping event network-vif-unplugged {{(pid=117833) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 19:30:08.146300 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9ecf8f39-c8db-4075-bfbe-05b00f754139 req-f8a55dda-8bb3-420d-92cb-e3884858a2a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030973 Aug 07 19:30:08.146901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 255/488] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 19:30:08.347332 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:08.348027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:08.354797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.355285 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.355712 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.356548 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.357069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.357483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.383523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c00775d5-78e0-45e9-98d1-fd161d5d142c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.399792 Aug 07 19:30:08.384610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 234/489] 10.222.0.17 () {62 vars in 1364 bytes} [Sun Aug 7 19:30:07 2022] POST /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments => generated 188 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:30:08.495136 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:08.495853 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:08.504663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.505437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.506049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.506931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.507543 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.508324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.533726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:08.543004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-27e69fbe-49b5-49fe-b0de-a6bd2da78796 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.199849 Aug 07 19:30:08.544311 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 256/490] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:08 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:08.549977 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:08.550546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:08.552489 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:08.557429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.557917 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.558464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.559016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.559711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.560146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.614875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117833) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 19:30:08.685293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:08.693759 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc1c245a-b324-4898-ac26-92b073ef17f1 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1653 microversion: 2.1 time: 0.203403 Aug 07 19:30:08.694341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 235/491] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:08 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1653 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:08.708208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b4019cb5-32e5-4c36-88fa-d538b214492f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/action" status: 202 len: 0 microversion: 2.20 time: 0.154275 Aug 07 19:30:08.708208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 257/492] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Aug 7 19:30:08 2022] POST /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:30:08.709875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:08.710427 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:08.716027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7e436aac-bd2f-4749-948e-4f6ef3b68678 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:08.720065 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.720562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.720994 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.721974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.722204 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.725681 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.726283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e436aac-bd2f-4749-948e-4f6ef3b68678 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.727094 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e436aac-bd2f-4749-948e-4f6ef3b68678 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.727766 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e436aac-bd2f-4749-948e-4f6ef3b68678 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.764807 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7e436aac-bd2f-4749-948e-4f6ef3b68678 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Going to try to start instance {{(pid=117832) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 19:30:08.825697 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7e436aac-bd2f-4749-948e-4f6ef3b68678 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.113759 Aug 07 19:30:08.829704 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 236/493] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:30:08 2022] POST /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:30:08.855788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:08.856701 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:08.885518 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.886003 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.886459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.887322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:08.887568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:08.888019 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:08.896280 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:08.908232 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:08.909948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:08.911137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b789a8e4-4043-4bfb-9f47-7275538ddf0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1750 microversion: 2.20 time: 0.206141 Aug 07 19:30:08.925008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 258/494] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:08 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1750 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:09.134503 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:09.135172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:09.142029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:09.142519 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:09.142952 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:09.143912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:09.144459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:09.144948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:09.438685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:09.442220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:09.446726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6cdeede8-12fb-41ba-9447-7ac2dac51527 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.316281 Aug 07 19:30:09.447314 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 259/495] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:09 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:09.452544 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eb8d4fa2-2b98-469d-af13-2f4b1d25ef4d tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1662 microversion: 2.1 time: 0.619915 Aug 07 19:30:09.453080 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 237/496] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:08 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1662 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:09.569463 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:09.570214 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:09.576122 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:09.576809 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:09.577117 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:09.577690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:09.578197 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:09.578603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:09.723068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:09.732025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-615d6e59-06f0-479c-ad2e-196d1399660e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.166399 Aug 07 19:30:09.736067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 260/497] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:09 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:09.938843 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:09.939577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:09.946017 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:09.946503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:09.947109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:09.948582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:09.948983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:09.949415 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:10.090438 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:10.095927 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:10.103070 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:10.104588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:10.105745 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9c004b3e-7d03-4f2e-9aed-86106ed41e1c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1750 microversion: 2.20 time: 0.171008 Aug 07 19:30:10.106493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 238/498] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:09 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:10.468208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:10.468843 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:10.473331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:10.474338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:10.475510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:10.476041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:10.476450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:10.477144 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:10.477648 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:10.478346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:10.483744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:10.484455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:10.484921 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:10.485680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:10.486208 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:10.486827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:10.681084 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:10.687154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:10.694182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3461e080-1547-4383-ab76-3e0c745bab42 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1662 microversion: 2.1 time: 0.225237 Aug 07 19:30:10.695316 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 239/499] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:10 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:10.704940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2cedde2d-6739-4e96-ae31-906c3b136bcc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.230906 Aug 07 19:30:10.705598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 261/500] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:10 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:10.753450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:10.754066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:10.760454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:10.760943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:10.761376 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:10.762072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:10.762528 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:10.762948 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:10.898533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:10.913861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c36ee2c1-f28e-4c13-aff6-413fcb716817 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.164224 Aug 07 19:30:10.927831 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 240/501] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:10 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:11.129864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:11.130378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:11.136789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.137290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.137711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:11.138390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.138833 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.139244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:11.276543 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:11.289420 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:11.291909 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:11.293697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b2911419-6de2-46f3-9299-0a77a0f13fc0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1752 microversion: 2.20 time: 0.167692 Aug 07 19:30:11.294500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 262/502] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:11 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:11.715292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:11.715887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:11.722941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.723426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.724024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:11.724757 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.725209 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.725635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:11.725774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:11.726364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:11.732995 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.733469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.733900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:11.734585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.735032 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.735453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:11.944024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:11.947455 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:11.953406 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e1d4ba9c-8420-4e70-83c4-d806f3fcd845 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1666 microversion: 2.1 time: 0.241941 Aug 07 19:30:11.957831 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 241/503] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:11 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1666 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:11.961674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ffea2044-bb9d-4143-8a33-7e357f9d693b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.239706 Aug 07 19:30:11.962140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:11.962882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:11.963060 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 263/504] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:11 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:11.969314 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.969893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.970388 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:11.971153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:11.971669 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:11.972721 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:12.125746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:12.134182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6fe203fe-3517-4fab-8f24-fde22b025dad tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.177586 Aug 07 19:30:12.134749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 242/505] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:11 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:12.321206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:12.321955 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:12.328182 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:12.328934 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:12.329533 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:12.330416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:12.330872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:12.331293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:12.475040 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:12.483615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:12.485127 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:12.486270 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f689d5c-ca63-488d-9908-5edcd5c02bdb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1752 microversion: 2.20 time: 0.169387 Aug 07 19:30:12.486861 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 264/506] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:12 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:12.983811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:12.984486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:12.991602 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:12.992136 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:12.992575 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:12.993334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:12.993789 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:12.994220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:13.141130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:13.149475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da3b9a97-c76c-453c-836e-76582eb21e00 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.169884 Aug 07 19:30:13.150357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 243/507] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:12 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:13.156594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:13.157210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:13.164145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:13.164670 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:13.165076 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:13.165785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:13.166234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:13.166736 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:13.305326 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:13.313957 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-73c59787-e199-40f5-9023-b4098b2cb5bb tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.161199 Aug 07 19:30:13.314520 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 265/508] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:13 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:13.509453 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:13.509977 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:13.511856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:13.512585 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:13.519708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:13.520234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:13.520723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:13.521415 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:13.521870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:13.522279 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:13.669898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:13.680380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:13.681913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:13.683091 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9db5c961-bea5-4133-b048-1c0fd3025e0c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.177715 Aug 07 19:30:13.683661 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 244/509] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:13 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:14.172486 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:14.174304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:14.176925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:14.184860 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:14.185622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:14.186203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:14.187219 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:14.188038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:14.188693 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:14.206629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-890ceee6-d0a0-4a17-b0d7-9fa69aca65a5 req-de5de63e-7b9a-4618-b834-31c19fdb2a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0", "name": "network-vif-plugged", "status": "completed", "tag": "23b8cc87-f2b3-49cd-a6d4-33f1831666b8"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:14.233518 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-890ceee6-d0a0-4a17-b0d7-9fa69aca65a5 req-de5de63e-7b9a-4618-b834-31c19fdb2a87 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:14.234008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-890ceee6-d0a0-4a17-b0d7-9fa69aca65a5 req-de5de63e-7b9a-4618-b834-31c19fdb2a87 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:14.234439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-890ceee6-d0a0-4a17-b0d7-9fa69aca65a5 req-de5de63e-7b9a-4618-b834-31c19fdb2a87 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:14.261552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-890ceee6-d0a0-4a17-b0d7-9fa69aca65a5 req-de5de63e-7b9a-4618-b834-31c19fdb2a87 service nova] Creating event network-vif-plugged:23b8cc87-f2b3-49cd-a6d4-33f1831666b8 for instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 on hv-cinder-85032 Aug 07 19:30:14.271573 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-890ceee6-d0a0-4a17-b0d7-9fa69aca65a5 req-de5de63e-7b9a-4618-b834-31c19fdb2a87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068475 Aug 07 19:30:14.272122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 245/510] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:14.352732 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:14.354882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:14.366658 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:14.373147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:14.374423 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:14.374964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:14.375774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:14.376422 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:14.377026 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:14.390456 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a9dd294d-c454-44cb-8e7b-f54b255d2131 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.222465 Aug 07 19:30:14.391602 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 266/511] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:14 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:14.542326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:14.553741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2fe85cfa-9a8e-46aa-a017-9cacc7d6b168 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.213066 Aug 07 19:30:14.554683 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 246/512] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:14 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:14.707967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:14.708598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:14.715460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:14.715937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:14.716412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:14.717105 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:14.717547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:14.717968 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:14.869605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:14.878648 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:14.880348 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:14.881615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-88b3b85a-246d-409a-871a-300906d6283b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.178194 Aug 07 19:30:14.882437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 267/513] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:14 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:15.414966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:15.415648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:15.423064 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:15.423818 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:15.424463 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:15.425467 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:15.426069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:15.426641 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:15.563805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:15.574594 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e02248ce-88a5-4659-ae10-727107950b04 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.163704 Aug 07 19:30:15.575192 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:15.575810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:15.576938 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 247/514] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:15 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:15.597618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:15.598114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:15.598828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:15.599551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:15.600032 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:15.600454 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:15.742946 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:15.751773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-de971f9e-18fe-4848-8fb9-a36510f25b2c tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.180519 Aug 07 19:30:15.752789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 268/515] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:15 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:15.905436 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:15.906059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:15.912649 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:15.913116 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:15.913577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:15.914285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:15.914741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:15.915166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:16.054039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:16.063347 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:16.064904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:16.066054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3775f12c-0016-438a-bcb7-4009a634b6d4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.164664 Aug 07 19:30:16.066625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 248/516] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:15 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:16.600835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:16.601460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:16.608279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:16.608785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:16.609218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:16.609928 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:16.610372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:16.610789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:16.751044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:16.759329 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-34ac2107-d608-452e-af40-6024f9f1826d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.162314 Aug 07 19:30:16.759875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 269/517] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:16 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:16.773154 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:16.773752 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:16.781376 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:16.781964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:16.782474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:16.783253 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:16.783885 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:16.785108 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:16.930878 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:16.939867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e13dbf3c-044e-4a9c-80a7-4235038eb42e tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.170018 Aug 07 19:30:16.944299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 249/518] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:16 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:17.092592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:17.093243 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:17.101279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:17.101769 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:17.102197 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:17.102912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:17.103356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:17.103775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:17.376691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:17.376691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:17.390630 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:17.393788 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:17.395636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cc15db56-2232-4d74-b026-ab3d7e70b892 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.306857 Aug 07 19:30:17.406771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 270/519] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:17 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:17.780168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:17.780820 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:17.787725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:17.788319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:17.788753 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:17.789466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:17.789913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:17.790335 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:17.964370 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:17.965812 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:17.974080 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:17.979453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:17.980213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:17.980666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:17.981663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:17.982438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:17.983025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:17.990089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1a5260c3-25f1-4204-a306-382a537b26c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.213848 Aug 07 19:30:17.996092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 250/520] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:17 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:18.142672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:18.151407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-186d1a47-769e-4ea2-b869-26b259263ea2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.193582 Aug 07 19:30:18.152229 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 271/521] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:17 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:18.421128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:18.421737 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:18.428085 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:18.428573 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:18.429006 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:18.429716 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:18.430158 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:18.430577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:18.570280 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:18.578925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:18.580466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:18.581629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2233f6c6-e560-4607-a979-5bd450a9f4eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.165162 Aug 07 19:30:18.582230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 251/522] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:18 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:19.011390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:19.012025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:19.018940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:19.019434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:19.020014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:19.020816 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:19.021334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:19.021663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:19.162326 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:19.172335 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:19.173114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:19.182837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ac881de5-60c3-48a6-a668-e837393ee7b0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.175388 Aug 07 19:30:19.183644 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 272/523] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:19 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:19.184866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:19.185347 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:19.185771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:19.186473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:19.186915 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:19.187327 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:19.324642 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:19.333286 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9334a47a-e18f-41f0-a581-cab170198d9b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.165118 Aug 07 19:30:19.334079 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 252/524] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:19 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:19.606992 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:19.607485 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:19.614168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:19.614765 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:19.615192 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:19.615883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:19.616351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:19.616765 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:19.755116 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:19.768457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:19.770015 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:19.771251 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d5fc7b33-4053-4a90-ae07-0ced44a2277c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.168410 Aug 07 19:30:19.771928 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 273/525] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:19 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:20.204986 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:20.205590 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:20.212449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:20.212940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:20.213382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:20.214078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:20.214534 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:20.214941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:20.352509 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:20.354871 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:20.355528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:20.363634 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:20.364269 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:20.364761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:20.365560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:20.366144 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:20.366593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:20.370627 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d4672df6-ece7-4baf-a8ac-bdaae300cc48 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.169342 Aug 07 19:30:20.373540 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 253/526] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:20 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:20.515984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:20.524508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8be19a55-593c-4816-ae45-9838796db032 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.173404 Aug 07 19:30:20.525081 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 274/527] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:20 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:20.795424 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:20.796355 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:20.802630 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:20.803105 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:20.803541 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:20.804268 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:20.804725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:20.805214 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:20.945681 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:20.955934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:20.957478 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:20.958845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d1826450-f92f-4418-b037-cfcddc74fa87 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.167599 Aug 07 19:30:20.959472 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 254/528] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:20 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:21.394721 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:21.395380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:21.402468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:21.402956 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:21.403388 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:21.404237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:21.404758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:21.405186 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:21.547615 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:21.548364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:21.555489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:21.564430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:21.564993 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:21.565567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:21.565751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:21.566300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:21.567184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:21.575468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-89611811-734d-4193-831b-d15d92af2703 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.184572 Aug 07 19:30:21.576404 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 275/529] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:21 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:21.717790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:21.728309 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-49ef1be0-1981-450f-980c-e4468bd9d3a1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.184662 Aug 07 19:30:21.729216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 255/530] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:21 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:21.983427 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:21.984067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:21.990606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:21.991079 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:21.991493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:21.992257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:21.992704 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:21.993122 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:22.128663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:22.137848 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:22.139334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:22.140558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c8785cc9-589f-4804-ab46-e4ecfae55f4f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.161088 Aug 07 19:30:22.141088 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 276/531] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:21 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:22.597550 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:22.598163 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:22.605241 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:22.605728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:22.606156 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:22.606844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:22.607298 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:22.607719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:22.611841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:22.750081 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:22.750654 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:22.750769 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:22.757560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:22.758045 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:22.758476 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:22.758741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6e50c998-32e0-4820-8c03-551b1bdf29ab tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.165142 Aug 07 19:30:22.759173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:22.759317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 256/532] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:22 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:22.759622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:22.760039 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:22.892375 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:22.901222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bbbe88ac-4f64-4df6-bf07-a42fc247189f tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.154943 Aug 07 19:30:22.901800 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 277/533] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:22 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:23.167502 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:23.168216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:23.175106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:23.175498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:23.175926 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:23.176645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:23.177093 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:23.177508 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:23.315784 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:23.324788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:23.326292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:23.327506 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-176fe557-2048-473f-8903-0e3928e0f2d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.164035 Aug 07 19:30:23.328609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 257/534] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:23 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:23.779218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:23.779810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:23.787100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:23.787525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:23.787954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:23.788687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:23.789145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:23.789526 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:23.923697 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:23.924309 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:23.928298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:23.931282 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:23.931781 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:23.932246 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:23.932946 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:23.933401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:23.933824 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:23.936682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0381f17d-be61-444b-af80-79cfbb8a8ed0 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.161347 Aug 07 19:30:23.937439 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 278/535] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:23 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:24.072816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:24.081926 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-03231b6a-76a2-4a04-88ff-32e762783eae tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.162500 Aug 07 19:30:24.082507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 258/536] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:23 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:24.351256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:24.351784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:24.358566 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:24.359048 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:24.359496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:24.360224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:24.360669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:24.361088 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:24.517836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:24.528397 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:24.529933 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:24.531104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ca883f61-215f-4cac-bff6-89ee8863e3a5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.184023 Aug 07 19:30:24.531665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 279/537] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:24 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:24.960783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:24.961363 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:24.970475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:24.970964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:24.971399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:24.972139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:24.972600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:24.973162 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:25.103731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:25.104501 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:25.110957 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:25.111438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:25.111852 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:25.112617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:25.113069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:25.113484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:25.114409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:25.122042 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7527748f-6ee5-4437-9ea7-b011b0a769e4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.167665 Aug 07 19:30:25.122617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 259/538] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:24 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:25.250661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:25.260871 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eccbb505-cd3a-470e-8d54-3121d3e55211 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.161096 Aug 07 19:30:25.262053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 280/539] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:25 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:25.555402 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:25.556145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:25.562722 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:25.563198 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:25.563638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:25.564362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:25.564805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:25.565220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:25.698489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:25.707599 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:25.709120 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:25.710309 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b11554ee-d31a-44aa-9fef-c73b7bb837eb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.159229 Aug 07 19:30:25.710836 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 260/540] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:25 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:26.142942 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:26.143506 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:26.150407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:26.150886 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:26.151309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:26.152024 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:26.152471 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:26.152882 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:26.282491 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:26.283273 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:26.290020 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:26.290512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:26.290987 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:26.291664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:26.292343 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:26.292771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:26.302145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:26.310121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0ec7b0ca-dbc1-4c16-b6a2-c6e81a2bb20b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1364 microversion: 2.1 time: 0.171080 Aug 07 19:30:26.310673 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 281/541] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:26 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:26.435409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:26.446096 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cfe10478-c665-4022-a270-9b4c69b5ee63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.167445 Aug 07 19:30:26.446684 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 261/542] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:26 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:26.733496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:26.734136 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:26.740284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:26.740772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:26.741210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:26.742088 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:26.742543 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:26.742967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:26.873841 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:26.882658 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:26.884205 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:26.885372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b530ba8c-e153-400a-98a1-775f481830ff tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.155898 Aug 07 19:30:26.885940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 282/543] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:26 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:27.335310 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:27.335927 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:27.342877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.343432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.344226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:27.344612 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.345066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.345492 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:27.468391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:27.469493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:27.477279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.478121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.478645 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:27.479477 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.481006 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.481006 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:27.496760 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:27.505887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8bca555c-4ead-473d-a7a6-bfa0fd229918 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1554 microversion: 2.1 time: 0.174652 Aug 07 19:30:27.506577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 262/544] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:27 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:27.529861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:27.530372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:27.536481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:27.538720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.539289 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.539925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:27.540852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.541317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.541731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:27.646252 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ae5e7419-247f-409d-ad8b-4cfacfdf8ff4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123210 Aug 07 19:30:27.646862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 263/545] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:30:27 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:27.674430 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:27.683000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1abc6887-376c-44a0-938e-6cda674a03de tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.219837 Aug 07 19:30:27.683552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 283/546] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:27 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:27.914482 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:27.915512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:27.925328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.925840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.926255 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:27.926951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:27.927406 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:27.927852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:28.082399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:28.091283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:28.092836 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:28.094254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a0416b46-4548-490e-aead-1da53d183777 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.187250 Aug 07 19:30:28.096036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 264/547] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:27 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:28.201377 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7a2ab65d-52d1-4a6d-bc2a-6ff6ea5ab547 req-6915b449-7263-4975-9e11-fc51c5446fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20345500-7cc0-4cd4-9c7a-35fc42ba4a32", "name": "network-vif-plugged", "status": "completed", "tag": "a274bf48-e334-42be-b1f2-d9db7f626a04"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:28.211668 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7a2ab65d-52d1-4a6d-bc2a-6ff6ea5ab547 req-6915b449-7263-4975-9e11-fc51c5446fad service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:28.212527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7a2ab65d-52d1-4a6d-bc2a-6ff6ea5ab547 req-6915b449-7263-4975-9e11-fc51c5446fad service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:28.212959 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7a2ab65d-52d1-4a6d-bc2a-6ff6ea5ab547 req-6915b449-7263-4975-9e11-fc51c5446fad service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:28.231717 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7a2ab65d-52d1-4a6d-bc2a-6ff6ea5ab547 req-6915b449-7263-4975-9e11-fc51c5446fad service nova] Creating event network-vif-plugged:a274bf48-e334-42be-b1f2-d9db7f626a04 for instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 on hv-cinder-85032 Aug 07 19:30:28.237161 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7a2ab65d-52d1-4a6d-bc2a-6ff6ea5ab547 req-6915b449-7263-4975-9e11-fc51c5446fad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040691 Aug 07 19:30:28.238344 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 284/548] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:28.644074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-6eda2e03-f930-47ec-b319-6325f2d18358 req-a4a6f14d-210d-4434-bd5a-db89bd1005fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0", "tag": "23b8cc87-f2b3-49cd-a6d4-33f1831666b8"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:28.657383 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6eda2e03-f930-47ec-b319-6325f2d18358 req-a4a6f14d-210d-4434-bd5a-db89bd1005fa service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:28.658819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6eda2e03-f930-47ec-b319-6325f2d18358 req-a4a6f14d-210d-4434-bd5a-db89bd1005fa service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:28.659471 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6eda2e03-f930-47ec-b319-6325f2d18358 req-a4a6f14d-210d-4434-bd5a-db89bd1005fa service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:28.671408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-6eda2e03-f930-47ec-b319-6325f2d18358 req-a4a6f14d-210d-4434-bd5a-db89bd1005fa service nova] Creating event network-changed:23b8cc87-f2b3-49cd-a6d4-33f1831666b8 for instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 on hv-cinder-85032 Aug 07 19:30:28.677386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-6eda2e03-f930-47ec-b319-6325f2d18358 req-a4a6f14d-210d-4434-bd5a-db89bd1005fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037173 Aug 07 19:30:28.677991 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 265/549] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:28.713489 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:28.714210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:28.722915 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:28.723962 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:28.724908 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:28.725854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:28.726726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:28.727325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:28.886049 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:28.898076 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8ea2ae9c-a785-41bc-8e0c-471f42500cde tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1736 microversion: 2.1 time: 0.189553 Aug 07 19:30:28.899792 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 285/550] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:28 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:29.119290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:29.120267 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:29.127572 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:29.128060 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:29.128488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:29.129393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:29.129854 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:29.130469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:29.284242 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:29.298523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:29.302407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:29.302407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ab528e5d-b34c-4be2-80f4-97c9c6134aa9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.187392 Aug 07 19:30:29.303525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 266/551] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:29 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:29.921297 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:29.923010 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:29.930018 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:29.930782 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:29.931217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:29.931917 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:29.932554 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:29.932978 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.095924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:30.107268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-693662ac-77ba-465c-ae97-57c299472461 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1716 microversion: 2.1 time: 0.190724 Aug 07 19:30:30.108208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 286/552] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:29 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1716 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:30.238569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:30.239175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:30.245695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.246175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.246610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.247354 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.247805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.248248 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.326063 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:30.326785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:30.333769 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.334327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.334753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.335461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.336008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.336473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.381624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] HTTP exception thrown: Cannot 'detach_volume' instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b while it is in vm_state rescued Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Request method failure captured: Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments/e451bdfb-0951-422b-b743-d50619cc299a HTTP/1.1 Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHUMfeFcA0vPGrwcpD6to5-Zis3n4fh-7LM-v1CVIs7l3u3s2eJuzUJybzvMYervGLtni9GY8diy5ko9vV5_IP4WfE29PaoJ24OcBgSzpbd8LA84m8WPg6rCiv4_d1Wt5OeqT-UVubX1pgJV4YSeE4nfCHEXDU4J0aZxILPfucZIl4 Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:30:30.383426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fe60f1637744c3f8a25e83f48bfdf71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: f643fd4ee6bc4ccfae45f3b8523ae46a Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:30:30.384866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Cannot 'detach_volume' instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b while it is in vm_state rescued Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'server_id': 'd24bc3ee-0e1c-4532-8859-2c6e8a675b3b', 'id': 'e451bdfb-0951-422b-b743-d50619cc299a'} Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:30:30.385517 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b while it is in vm_state rescued Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b while it is in vm_state rescued Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:30:30.386763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Returning 409 to user: Cannot 'detach_volume' instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b while it is in vm_state rescued {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:30:30.387720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4803deb5-0fda-40cb-a20c-d2d66fccbaea tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments/e451bdfb-0951-422b-b743-d50619cc299a" status: 409 len: 152 microversion: 2.1 time: 0.150335 Aug 07 19:30:30.387720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 267/553] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:30:30 2022] DELETE /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments/e451bdfb-0951-422b-b743-d50619cc299a => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 19:30:30.396661 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:30.397184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:30.404140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.404631 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.408371 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.408371 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.408371 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.408371 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.487383 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a40fbf26-a886-458f-9ccf-3d0ebc655737 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "POST /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/action" status: 202 len: 0 microversion: 2.1 time: 0.094342 Aug 07 19:30:30.488111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 268/554] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:30:30 2022] POST /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:30:30.497202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:30.497912 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:30.500783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:30.504513 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.505078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.505612 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.506393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:30.506919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:30.507349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:30.512555 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:30.514334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:30.515518 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7e088dd0-0441-48c0-a2f4-58f750b78aba tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.193562 Aug 07 19:30:30.516184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 287/555] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:30 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:30.653264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:30.663607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1e961b1d-35ad-4409-9def-bd95701eea1b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1724 microversion: 2.1 time: 0.170555 Aug 07 19:30:30.664233 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 269/556] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:30 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:31.538576 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:31.539200 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:31.546435 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:31.546903 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:31.547323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:31.548021 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:31.548469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:31.548912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:31.551868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:31.691694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:31.692942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:31.702835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:31.703317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:31.703756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:31.703943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:31.704488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:31.704936 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:31.705348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:31.712749 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:31.714368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:31.715511 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ad70f645-ee29-4dca-802e-dec92122c9ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.180956 Aug 07 19:30:31.716121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 288/557] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:31 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:31.865822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:31.878868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cb9ea722-7e01-418d-8a40-9519b86659f1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1724 microversion: 2.1 time: 0.194563 Aug 07 19:30:31.881138 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 270/558] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:31 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:32.739096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:32.739669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:32.746937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:32.747419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:32.747847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:32.748607 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:32.749057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:32.749473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:32.899252 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:32.900605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:32.901228 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:32.908028 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:32.908543 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:32.908728 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:32.909024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:32.909733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:32.910060 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:32.910225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:32.910595 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:32.911230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-763e96bd-daaf-409d-a6f8-abbb0d8ccecb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1808 microversion: 2.20 time: 0.176182 Aug 07 19:30:32.911795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 289/559] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:32 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:33.057965 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:33.068730 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7bb4583a-8eb0-4874-8be3-db4cf2a76733 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1724 microversion: 2.1 time: 0.172110 Aug 07 19:30:33.069316 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 271/560] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:32 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:33.937355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:33.937969 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:33.944125 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:33.944616 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:33.945041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:33.946505 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:33.946505 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:33.946710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:34.093903 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:34.094658 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:34.101310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:34.102205 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:34.102738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:34.103184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:34.103922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:34.104391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:34.105062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:34.111665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:34.113444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:34.114822 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-77452774-c76a-4833-b272-eb0555343826 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1795 microversion: 2.20 time: 0.182101 Aug 07 19:30:34.115904 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 290/561] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:30:33 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1795 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:30:34.251012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:34.254635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:34.260641 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-755fced1-0b3e-4b2f-afbb-cd05d1a7d014 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1730 microversion: 2.1 time: 0.173005 Aug 07 19:30:34.261352 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 272/562] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:34 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:30:34.281922 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:34.282411 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:34.290374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:34.290987 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:34.291595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:34.292697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:34.293154 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:34.293603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:34.382285 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7fb06532-fa93-4739-993a-7ad34a6c73bd tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104588 Aug 07 19:30:34.382854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 291/563] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:30:34 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:35.329548 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-63bab8a5-d08e-4c0f-9d17-344a8bf3cd4a req-c8ec1fbb-5ca1-4545-a3b4-dcf27a265cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24bc3ee-0e1c-4532-8859-2c6e8a675b3b", "tag": "7789ece0-abb9-4195-8580-f0706364a37d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:35.341975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-63bab8a5-d08e-4c0f-9d17-344a8bf3cd4a req-c8ec1fbb-5ca1-4545-a3b4-dcf27a265cd0 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:35.342922 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-63bab8a5-d08e-4c0f-9d17-344a8bf3cd4a req-c8ec1fbb-5ca1-4545-a3b4-dcf27a265cd0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:35.343339 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-63bab8a5-d08e-4c0f-9d17-344a8bf3cd4a req-c8ec1fbb-5ca1-4545-a3b4-dcf27a265cd0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:35.356695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-63bab8a5-d08e-4c0f-9d17-344a8bf3cd4a req-c8ec1fbb-5ca1-4545-a3b4-dcf27a265cd0 service nova] Creating event network-changed:7789ece0-abb9-4195-8580-f0706364a37d for instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b on hv-cinder-85032 Aug 07 19:30:35.362200 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-63bab8a5-d08e-4c0f-9d17-344a8bf3cd4a req-c8ec1fbb-5ca1-4545-a3b4-dcf27a265cd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038253 Aug 07 19:30:35.362799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 273/564] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:37.377949 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-76ee85c6-40af-4b42-b651-7660c510d89c req-a50e9f8a-6b00-4348-8e79-6ec672f7e153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24bc3ee-0e1c-4532-8859-2c6e8a675b3b", "tag": "7789ece0-abb9-4195-8580-f0706364a37d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:37.388238 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-76ee85c6-40af-4b42-b651-7660c510d89c req-a50e9f8a-6b00-4348-8e79-6ec672f7e153 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:37.388700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-76ee85c6-40af-4b42-b651-7660c510d89c req-a50e9f8a-6b00-4348-8e79-6ec672f7e153 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:37.389115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-76ee85c6-40af-4b42-b651-7660c510d89c req-a50e9f8a-6b00-4348-8e79-6ec672f7e153 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:37.400379 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-76ee85c6-40af-4b42-b651-7660c510d89c req-a50e9f8a-6b00-4348-8e79-6ec672f7e153 service nova] Creating event network-changed:7789ece0-abb9-4195-8580-f0706364a37d for instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b on hv-cinder-85032 Aug 07 19:30:37.405449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-76ee85c6-40af-4b42-b651-7660c510d89c req-a50e9f8a-6b00-4348-8e79-6ec672f7e153 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031757 Aug 07 19:30:37.406016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 292/565] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:46.156198 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=21 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:46.156948 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:46.161549 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:46.163839 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:46.171794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:46.172335 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:46.172760 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:46.173454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:46.173919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:46.174338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:46.204473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc0d6fbc-c7bf-4e84-a4da-a80f496072d4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049955 Aug 07 19:30:46.205098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 274/566] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:30:46 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:30:46.269948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:46.270483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:46.272515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:46.279400 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:46.279883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:46.280351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:46.281169 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:46.281620 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:46.282037 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:46.314969 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:30:46.396194 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8e04fef8-734b-4313-82a6-81177fb7bcc4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 204 len: 0 microversion: 2.1 time: 0.130929 Aug 07 19:30:46.396880 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 293/567] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:30:46 2022] DELETE /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:30:46.405840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:46.406466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:46.413628 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:46.414114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:46.414535 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:46.415272 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:46.415874 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:46.416276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:46.556636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:46.564624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-936d4b16-5f3f-43f5-a650-7d7758062c81 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1672 microversion: 2.1 time: 0.162981 Aug 07 19:30:46.566713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 275/568] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:46 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:47.589345 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:47.590179 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:47.597924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:47.598404 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:47.598825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:47.599542 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:47.599975 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:47.602139 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:47.741925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:47.750202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a5cb1839-06f9-4557-af42-d7e4fa530448 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1672 microversion: 2.1 time: 0.165143 Aug 07 19:30:47.750787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 294/569] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:47 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:48.772455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:48.774318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:48.785852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:48.786804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:48.787206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:48.787937 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:48.788441 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:48.788870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:48.930870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:48.939836 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3080d210-cd94-4a56-bca2-147020079018 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1672 microversion: 2.1 time: 0.172423 Aug 07 19:30:48.940588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 276/570] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:48 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:49.862955 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-3c7f4344-7b70-47c2-bb55-9155a1cec0f4 req-646865a2-2f14-411b-9ccc-2f42009e46d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7", "name": "network-vif-deleted", "tag": "539ffdda-b91d-4657-ac08-52d85aa595d6"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:49.878857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3c7f4344-7b70-47c2-bb55-9155a1cec0f4 req-646865a2-2f14-411b-9ccc-2f42009e46d0 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:49.879433 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3c7f4344-7b70-47c2-bb55-9155a1cec0f4 req-646865a2-2f14-411b-9ccc-2f42009e46d0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:49.881912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3c7f4344-7b70-47c2-bb55-9155a1cec0f4 req-646865a2-2f14-411b-9ccc-2f42009e46d0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:49.893628 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-3c7f4344-7b70-47c2-bb55-9155a1cec0f4 req-646865a2-2f14-411b-9ccc-2f42009e46d0 service nova] Creating event network-vif-deleted:539ffdda-b91d-4657-ac08-52d85aa595d6 for instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 on hv-cinder-85032 Aug 07 19:30:49.900568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-3c7f4344-7b70-47c2-bb55-9155a1cec0f4 req-646865a2-2f14-411b-9ccc-2f42009e46d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041472 Aug 07 19:30:49.901511 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 295/571] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:49.961841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:49.963042 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:49.971516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:49.972284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:49.976067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:49.979453 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:49.985649 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:49.986451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:50.067962 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:50.077795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f80701e5-9aaf-42d8-9b75-d15fb6df9776 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 200 len: 1321 microversion: 2.1 time: 0.119505 Aug 07 19:30:50.078773 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 277/572] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:49 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 1321 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:51.101454 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:51.102190 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:51.108622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:51.110652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:51.111193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:51.112230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:51.112685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:51.113122 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:51.127575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] HTTP exception thrown: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Request method failure captured: Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 HTTP/1.1 Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHWoumIDFpH7LpnnikAU_KFKLvGmVgAeLYgHf5jOYsXuy8SNn_hCexnBtSgftHFTi8kqYedN7n2y6TtdrFD6lhEBiKWFQ2uSnuENtTVwIntYS5Lt7UphUif1BGZ7jLjIvsNL8IAOLWrzNBapJ1qqz7_xS95cpsvpNYN7Za9Vy0TDjA Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:30:51.129265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf93b388fac4be38661d185a7231937", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf93b388fac4be38661d185a7231937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 6732487041c54918b1164b1cb72bb07e Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:30:51.130617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7'} Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:30:51.131623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:30:51.133062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:30:51.134112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Returning 404 to user: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:30:51.134112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eaea6ab4-d5c1-49af-83f8-ed947dd44da3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 404 len: 111 microversion: 2.1 time: 0.034853 Aug 07 19:30:51.134112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 296/573] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:51 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:30:51.139832 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d55df250-9d42-4a79-9c19-0b5b9c0d1bb9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '.version_select at 0x7fd476c011f0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:51.162878 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d55df250-9d42-4a79-9c19-0b5b9c0d1bb9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418294533" status: 202 len: 0 microversion: 2.1 time: 0.026710 Aug 07 19:30:51.163526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 278/574] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Aug 7 19:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418294533 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:30:51.872891 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b4e97797-2c3c-4477-b3e0-d2cccc45028e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'create', calling method: .version_select at 0x7fd476c23dc0>, body: {"keypair": {"name": "tempest-keypair-872588595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgVIJYNijENXTdc5zlnHH9UamdzEoZcaa3eUQgCIlO0NZmYWjvDG2r+PXx38yZExUm+NalPK4ZTGm802QKw4dFmrIxreMPHcGHg0x5rgI9RShNwRwb8damUT+UWoy/a9g=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:51.888302 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b4e97797-2c3c-4477-b3e0-d2cccc45028e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for project fcf93b388fac4be38661d185a7231937. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:30:51.892178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b4e97797-2c3c-4477-b3e0-d2cccc45028e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for user 6732487041c54918b1164b1cb72bb07e and project fcf93b388fac4be38661d185a7231937. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:30:51.916983 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b4e97797-2c3c-4477-b3e0-d2cccc45028e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048071 Aug 07 19:30:51.917880 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 297/575] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:30:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:30:53.179955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-285652672", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf733bd5-517a-49a5-a4fd-6f494e57a979"}], "security_groups": [{"name": "tempest-securitygroup--1280851417"}], "key_name": "tempest-keypair-872588595", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:53.287675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] validate_networks() for [('bf733bd5-517a-49a5-a4fd-6f494e57a979', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:30:53.905110 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:30:53.905537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:30:53.905983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:30:53.906385 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:30:53.906791 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:30:53.915599 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:53.916100 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:53.916529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:53.917249 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:53.917685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:53.918104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:53.935974 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for project fcf93b388fac4be38661d185a7231937. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:30:53.939960 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Getting quotas for user 6732487041c54918b1164b1cb72bb07e and project fcf93b388fac4be38661d185a7231937. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:30:53.951185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:30:53.953489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:30:54.000031 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5db2b995-4b79-40b7-a09b-9fdda31d377f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825208 Aug 07 19:30:54.000695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 279/576] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:30:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:30:54.012937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-96f71c17-409c-4271-971c-7e3e64926936 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:54.013550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-96f71c17-409c-4271-971c-7e3e64926936 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:54.069146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-96f71c17-409c-4271-971c-7e3e64926936 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:54.076228 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-96f71c17-409c-4271-971c-7e3e64926936 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1236 microversion: 2.1 time: 0.068277 Aug 07 19:30:54.076802 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 298/577] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:54 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:55.098985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:55.099582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:55.106287 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:55.106755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:55.107223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:55.107907 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:55.108415 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:55.108838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:55.191033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:55.199105 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f2339d71-5a70-48e3-985c-5b2143c8ffa7 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1288 microversion: 2.1 time: 0.105300 Aug 07 19:30:55.199689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 280/578] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:55 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:56.220652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:56.221263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:56.227917 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:56.228443 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:56.228893 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:56.229639 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:56.230089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:56.230509 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:56.367947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:56.377241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d9c23809-ea9e-47d6-a8cf-ff72b84dbeaf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1362 microversion: 2.1 time: 0.160517 Aug 07 19:30:56.377837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 299/579] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:56 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:56.950057 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-d1483bee-e90d-45d1-830f-105d57f2bccd req-dc07d523-6c3c-49c5-b09a-72b55e89bea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320fcd14-0960-44e8-9260-0a6b55a27c94", "tag": "0dca49b6-5eab-404c-928f-5926020a3172"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:30:56.960568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d1483bee-e90d-45d1-830f-105d57f2bccd req-dc07d523-6c3c-49c5-b09a-72b55e89bea1 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:56.961091 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d1483bee-e90d-45d1-830f-105d57f2bccd req-dc07d523-6c3c-49c5-b09a-72b55e89bea1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:56.961662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d1483bee-e90d-45d1-830f-105d57f2bccd req-dc07d523-6c3c-49c5-b09a-72b55e89bea1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:56.973414 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-d1483bee-e90d-45d1-830f-105d57f2bccd req-dc07d523-6c3c-49c5-b09a-72b55e89bea1 service nova] Creating event network-changed:0dca49b6-5eab-404c-928f-5926020a3172 for instance 320fcd14-0960-44e8-9260-0a6b55a27c94 on hv-cinder-85032 Aug 07 19:30:56.978949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-d1483bee-e90d-45d1-830f-105d57f2bccd req-dc07d523-6c3c-49c5-b09a-72b55e89bea1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033636 Aug 07 19:30:56.979538 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 281/580] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:30:57.398945 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:57.399562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:57.406582 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:57.407077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:57.407498 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:57.408223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:57.408883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:57.409309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:57.547006 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:57.554949 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b8998c07-b1eb-4821-9fe6-43c6cc46e6af tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1362 microversion: 2.1 time: 0.159994 Aug 07 19:30:57.555513 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 300/581] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:57 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:58.577834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:58.578530 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:58.585540 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:58.586048 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:58.586487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:58.587181 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:58.587639 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:58.588101 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:58.726330 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:58.733930 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5e978f6d-4508-4bb4-b907-5143a7e0a01a tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1362 microversion: 2.1 time: 0.160943 Aug 07 19:30:58.734486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 282/582] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:58 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:30:59.757347 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:30:59.758309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:30:59.767605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:59.768125 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:59.768560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:59.769253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:30:59.769701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:30:59.770123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:30:59.963750 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:30:59.972126 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6923bbc3-55c5-4183-bd12-fd62bb60adf2 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1362 microversion: 2.1 time: 0.220773 Aug 07 19:30:59.972750 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 301/583] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:30:59 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:00.993675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:00.994251 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:01.001533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:01.002006 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:01.002431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:01.003341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:01.003788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:01.004240 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:01.208013 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:01.215621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5db8053f-697a-4294-9776-b10063b58b9f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1362 microversion: 2.1 time: 0.225984 Aug 07 19:31:01.216213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 283/584] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:00 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:02.236020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:02.236599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:02.243841 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:02.244376 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:02.244810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:02.245510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:02.245965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:02.246384 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:02.249227 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:02.383510 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1e7c9387-48e2-43ad-a37a-e0a08c07b1d0 req-e22f299c-c7b7-4d31-8bdd-a7fe9a964a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320fcd14-0960-44e8-9260-0a6b55a27c94", "name": "network-vif-plugged", "status": "completed", "tag": "0dca49b6-5eab-404c-928f-5926020a3172"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:02.384307 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:02.393432 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-13dcc53c-57d8-4ee3-a447-094de0dc8abc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1362 microversion: 2.1 time: 0.161294 Aug 07 19:31:02.394172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 302/585] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:02 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:02.408975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1e7c9387-48e2-43ad-a37a-e0a08c07b1d0 req-e22f299c-c7b7-4d31-8bdd-a7fe9a964a04 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:02.409456 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1e7c9387-48e2-43ad-a37a-e0a08c07b1d0 req-e22f299c-c7b7-4d31-8bdd-a7fe9a964a04 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:02.409890 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1e7c9387-48e2-43ad-a37a-e0a08c07b1d0 req-e22f299c-c7b7-4d31-8bdd-a7fe9a964a04 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:02.422491 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1e7c9387-48e2-43ad-a37a-e0a08c07b1d0 req-e22f299c-c7b7-4d31-8bdd-a7fe9a964a04 service nova] Creating event network-vif-plugged:0dca49b6-5eab-404c-928f-5926020a3172 for instance 320fcd14-0960-44e8-9260-0a6b55a27c94 on hv-cinder-85032 Aug 07 19:31:02.427331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1e7c9387-48e2-43ad-a37a-e0a08c07b1d0 req-e22f299c-c7b7-4d31-8bdd-a7fe9a964a04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048740 Aug 07 19:31:02.427943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 284/586] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:03.416564 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:03.417336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:03.425705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:03.426188 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:03.426621 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:03.427325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:03.427794 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:03.428260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:03.568214 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:03.579686 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1d48aef9-1ef0-4f9d-9708-b9cbaf0a4a02 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1362 microversion: 2.1 time: 0.168473 Aug 07 19:31:03.580325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 303/587] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:03 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:04.604847 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:04.605623 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:04.609904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:04.610603 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:04.617856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:04.618276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:04.618711 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:04.619403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:04.619862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:04.620312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:04.752638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:04.760259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-56237b68-9df7-4efb-b34a-c93e185156c3 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1548 microversion: 2.1 time: 0.156788 Aug 07 19:31:04.760845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 285/588] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:04 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:04.787737 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:04.788372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:04.790098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:04.797108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:04.797562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:04.798112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:04.798813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:04.799268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:04.799696 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:04.878522 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0f2b2ff8-8eec-4f1a-a1dd-dc570899a095 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094312 Aug 07 19:31:04.879531 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 304/589] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:31:04 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:05.835654 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-7cddaf30-b09e-4eb7-a31e-396bfe1a8f79 req-9d4b8d38-ec85-485c-aa14-8ee95b2e6fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320fcd14-0960-44e8-9260-0a6b55a27c94", "tag": "0dca49b6-5eab-404c-928f-5926020a3172"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:05.845596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7cddaf30-b09e-4eb7-a31e-396bfe1a8f79 req-9d4b8d38-ec85-485c-aa14-8ee95b2e6fbb service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:05.846074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7cddaf30-b09e-4eb7-a31e-396bfe1a8f79 req-9d4b8d38-ec85-485c-aa14-8ee95b2e6fbb service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:05.846498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7cddaf30-b09e-4eb7-a31e-396bfe1a8f79 req-9d4b8d38-ec85-485c-aa14-8ee95b2e6fbb service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:05.857616 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-7cddaf30-b09e-4eb7-a31e-396bfe1a8f79 req-9d4b8d38-ec85-485c-aa14-8ee95b2e6fbb service nova] Creating event network-changed:0dca49b6-5eab-404c-928f-5926020a3172 for instance 320fcd14-0960-44e8-9260-0a6b55a27c94 on hv-cinder-85032 Aug 07 19:31:05.862828 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-7cddaf30-b09e-4eb7-a31e-396bfe1a8f79 req-9d4b8d38-ec85-485c-aa14-8ee95b2e6fbb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030887 Aug 07 19:31:05.863498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 286/590] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:12.530813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:12.531334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:12.537578 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.538058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.538491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.539181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.539631 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.540098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.563656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b103f386-7da5-4ec7-a9ae-73acc42fbdbd tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/ips" status: 200 len: 150 microversion: 2.1 time: 0.101434 Aug 07 19:31:12.564312 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 305/591] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:31:12 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/ips => generated 150 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:12.595222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:12.595939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:12.602623 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.603107 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.603519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.604235 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.604686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.605098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.634212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bb2ed878-27b9-4e91-bd24-b8800885be9d tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments/cd312e14-9e61-4f78-967d-8791fe3a1fc6" status: 200 len: 194 microversion: 2.20 time: 0.044266 Aug 07 19:31:12.634796 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 287/592] 10.222.0.17 () {60 vars in 1454 bytes} [Sun Aug 7 19:31:12 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments/cd312e14-9e61-4f78-967d-8791fe3a1fc6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:31:12.704526 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:12.705042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:12.713860 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.714602 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.715256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.716370 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.717016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.717630 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.805787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lazy-loading 'services' on Instance uuid 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:12.899612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6cf309f0-1e4c-4802-9c84-0db6248bc6a1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments/cd312e14-9e61-4f78-967d-8791fe3a1fc6" status: 202 len: 0 microversion: 2.20 time: 0.199441 Aug 07 19:31:12.903723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 306/593] 10.222.0.17 () {60 vars in 1457 bytes} [Sun Aug 7 19:31:12 2022] DELETE /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments/cd312e14-9e61-4f78-967d-8791fe3a1fc6 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:31:12.910648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:12.912856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:12.919768 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.920307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.921198 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.923458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:12.923941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:12.924400 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:12.959604 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-563e8543-5d66-44a0-bd24-d70e3f784400 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054608 Aug 07 19:31:12.960216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 288/594] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Aug 7 19:31:12 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:31:13.945746 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66e69d8e-18fe-4b70-af71-cc3a37e1f33e"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:13.948287 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:13.955031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:13.955542 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:13.955961 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:13.956728 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:13.957179 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:13.957585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:13.972723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:13.975182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:13.981577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:13.982056 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:13.982481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:13.983205 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:13.983658 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:13.984235 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:14.015366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d5b0186-5c7a-4906-b5a3-71690060f11b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046612 Aug 07 19:31:14.015952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 289/595] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Aug 7 19:31:13 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 19:31:14.095054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:14.095654 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:14.106656 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:14.107277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:14.107891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:14.109240 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:14.109704 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:14.110133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:14.143803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lazy-loading 'flavor' on Instance uuid 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:14.227035 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f1fb927d-9995-4795-a735-1736f83bd74d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "POST /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6/action" status: 202 len: 0 microversion: 2.1 time: 0.139989 Aug 07 19:31:14.227537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 290/596] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:31:14 2022] POST /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 19:31:14.236866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:14.237500 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:14.243651 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:14.244167 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:14.244594 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:14.245274 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:14.245719 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:14.246119 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:14.387787 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:14.395866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6ff3b3a1-5b81-458f-bae6-829bf5559f31 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.163614 Aug 07 19:31:14.396472 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 291/597] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:14 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:14.559541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4592a7ee-5391-4218-9618-cbf634ee3196 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619099 Aug 07 19:31:14.560226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 307/598] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:31:13 2022] POST /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:15.027421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:15.029630 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:15.036743 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.037235 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.037673 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.038431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.038829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.039258 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.043096 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:15.072256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6ad6da8e-7408-4f90-a672-13bf56c4104b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048851 Aug 07 19:31:15.072752 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 292/599] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Aug 7 19:31:15 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:15.143435 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:15.144020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:15.151168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.151638 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.152091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.152786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.153234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.153646 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.179930 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:31:15.271339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7a539c7d-eb12-42e0-9805-5e45a9bf0333 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 204 len: 0 microversion: 2.20 time: 0.131803 Aug 07 19:31:15.272391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 308/600] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Aug 7 19:31:15 2022] DELETE /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 19:31:15.280927 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:15.281576 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:15.287741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.288259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.288744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.289380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.289830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.290253 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.419711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:15.420829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:15.428178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.428338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:15.428664 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.429096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.429798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:15.430247 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:15.430665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:15.436752 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:15.438299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:15.439525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-53e5a453-ddeb-44bb-a546-833f17cc58c0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.162769 Aug 07 19:31:15.440128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 293/601] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:15 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:15.569419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:15.577615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f92273d4-823b-462e-9c2d-ef5047016871 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.162835 Aug 07 19:31:15.578363 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 309/602] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:15 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:16.265834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:16.266357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:16.268648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:16.274149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.274626 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.275080 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.275757 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.276322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.276748 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.363046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lazy-loading 'services' on Instance uuid d24bc3ee-0e1c-4532-8859-2c6e8a675b3b {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:16.463225 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:16.463895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:16.466633 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:16.472420 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.472900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.473331 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.474213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.474714 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.475218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.485334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-04635d81-8fa1-4d01-822d-bbf617a2afac tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments/e451bdfb-0951-422b-b743-d50619cc299a" status: 202 len: 0 microversion: 2.1 time: 0.223324 Aug 07 19:31:16.485867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 294/603] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:31:16 2022] DELETE /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments/e451bdfb-0951-422b-b743-d50619cc299a => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:31:16.494917 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:16.497273 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:16.503603 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.504197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.504638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.505340 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.505795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.506388 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.549008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ce6d9b5c-47fe-4c6d-a818-64d42d7a2231 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058347 Aug 07 19:31:16.549581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 295/604] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:16 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:31:16.599734 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:16.600407 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:16.606532 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.607122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.607531 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.608358 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:16.609057 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:16.609519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:16.612055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:16.621250 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:16.622747 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:16.623902 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3ed76791-0ee2-4aa0-a635-5955095f27ae tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.165230 Aug 07 19:31:16.624783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 310/605] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:16 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:31:16.747056 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:16.755052 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8b3322e4-a3c5-4586-9f3d-d23954d0872e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.159826 Aug 07 19:31:16.755667 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 296/606] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:16 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:17.562034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:17.564336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:17.571147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:17.571622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:17.572121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:17.572796 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:17.573255 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:17.573652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:17.604049 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4b21c6db-b576-42a6-82c4-3c2403177050 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Aug 07 19:31:17.609155 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 311/607] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:17 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:17.646934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:17.648502 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:17.659482 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:17.659969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:17.660437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:17.661145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:17.661602 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:17.662025 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:17.776421 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:17.777024 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:17.789640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:17.790368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:17.790974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:17.791853 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:17.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:17.793163 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:17.828939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:17.840685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:17.844328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:17.845745 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ab0953bb-018d-4845-850a-ea5cdc091052 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1723 microversion: 2.20 time: 0.202711 Aug 07 19:31:17.846782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 297/608] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:17 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:17.963390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:17.971679 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-065ab715-d9d8-48f3-8766-eb12acf26365 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.199011 Aug 07 19:31:17.972309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 312/609] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:17 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:18.556734 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-d7963db7-87cc-460b-b43c-ccb4d28a3908 req-4e736ece-f186-4c16-b13c-445f69cc68e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20345500-7cc0-4cd4-9c7a-35fc42ba4a32", "name": "network-vif-deleted", "tag": "a274bf48-e334-42be-b1f2-d9db7f626a04"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:18.567087 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d7963db7-87cc-460b-b43c-ccb4d28a3908 req-4e736ece-f186-4c16-b13c-445f69cc68e0 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:18.567645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d7963db7-87cc-460b-b43c-ccb4d28a3908 req-4e736ece-f186-4c16-b13c-445f69cc68e0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:18.568178 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d7963db7-87cc-460b-b43c-ccb4d28a3908 req-4e736ece-f186-4c16-b13c-445f69cc68e0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:18.580210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-d7963db7-87cc-460b-b43c-ccb4d28a3908 req-4e736ece-f186-4c16-b13c-445f69cc68e0 service nova] Creating event network-vif-deleted:a274bf48-e334-42be-b1f2-d9db7f626a04 for instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 on hv-cinder-85032 Aug 07 19:31:18.585418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-d7963db7-87cc-460b-b43c-ccb4d28a3908 req-4e736ece-f186-4c16-b13c-445f69cc68e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Aug 07 19:31:18.589123 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 298/610] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:18.618730 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:18.622478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:18.629334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:18.630089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:18.630588 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:18.631528 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:18.632209 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:18.632838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:18.669406 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-12cdc53e-6770-43c0-baba-351d48e33fb6 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056102 Aug 07 19:31:18.669997 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 313/611] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:18 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:18.870584 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:18.871285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:18.877774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:18.878386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:18.878827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:18.879527 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:18.879979 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:18.880458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:18.912601 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:18.913083 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:18.913598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:18.914593 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lazy-loading 'fault' on Instance uuid 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:18.972243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:18.983521 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:18.985216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:18.986424 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fd32c949-dd6a-4c85-b393-3dddd18cd6de tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 200 len: 1371 microversion: 2.20 time: 0.120748 Aug 07 19:31:18.992167 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 299/612] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:18 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:19.000074 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:19.000974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:19.010600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.011357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.012053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.014051 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.014973 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.015827 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.063984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66e69d8e-18fe-4b70-af71-cc3a37e1f33e"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:19.066727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:19.072839 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.073587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.074182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.075043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.075646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.076245 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.169209 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:19.177361 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Invalid volume: volume 66e69d8e-18fe-4b70-af71-cc3a37e1f33e is already attached to instances: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 Aug 07 19:31:19.177862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-93f31a23-7d5d-4f38-b8fa-936cc0d06d58 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.183842 Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments HTTP/1.1 Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 74 Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:31:19.181210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "66e69d8e-18fe-4b70-af71-cc3a37e1f33e"}} Aug 07 19:31:19.183043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Invalid volume: volume 66e69d8e-18fe-4b70-af71-cc3a37e1f33e is already attached to instances: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'server_id': 'b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0', 'body': {'volumeAttachment': {'volumeId': '66e69d8e-18fe-4b70-af71-cc3a37e1f33e'}}} Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 66e69d8e-18fe-4b70-af71-cc3a37e1f33e is already attached to instances: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:19.184484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 66e69d8e-18fe-4b70-af71-cc3a37e1f33e is already attached to instances: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:19.185707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:19.186903 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:19.186903 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:31:19.186903 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:31:19.186903 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 66e69d8e-18fe-4b70-af71-cc3a37e1f33e is already attached to instances: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 Aug 07 19:31:19.186903 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:19.188982 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 400 to user: Invalid volume: volume 66e69d8e-18fe-4b70-af71-cc3a37e1f33e is already attached to instances: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:31:19.190468 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b964f14-7a52-45e9-b212-4401dc33bb03 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131178 Aug 07 19:31:19.191817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 300/614] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:31:19 2022] POST /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 19:31:19.192143 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 314/614] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:18 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:19.263341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:19.263845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:19.271571 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.272366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.273072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.273782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.274229 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.274668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.367868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lazy-loading 'services' on Instance uuid b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:19.446286 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d5200b7-4bd9-46bc-b777-fd4f80e18c4b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments/66e69d8e-18fe-4b70-af71-cc3a37e1f33e" status: 202 len: 0 microversion: 2.1 time: 0.187559 Aug 07 19:31:19.447106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 301/615] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:31:19 2022] DELETE /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments/66e69d8e-18fe-4b70-af71-cc3a37e1f33e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:31:19.456578 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:19.458756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:19.465759 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.466575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.467092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.468084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.468965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.469480 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.500086 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:19.505470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cd774614-ef96-4896-9d85-608ba6567e71 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052916 Aug 07 19:31:19.506147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 315/616] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:19 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:31:19.683234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:19.685569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:19.692339 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.692822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.693259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.694270 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.694374 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.694808 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.724336 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a42a2cf3-2c69-4e36-9266-620f9b322e63 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045563 Aug 07 19:31:19.724916 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 302/617] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:19 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:31:19.810551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:19.811118 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:19.821612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.822229 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.822665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.823364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.823816 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.824270 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.854016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:31:19.943089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7e6a1e00-bb1b-47a3-ab68-754784f6913b tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 204 len: 0 microversion: 2.1 time: 0.138056 Aug 07 19:31:19.943586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 316/618] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:31:19 2022] DELETE /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:31:19.953107 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:19.953898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:19.960418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.960899 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.961328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:19.962012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:19.962456 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:19.962870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:20.010759 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:20.011847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:20.019403 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:20.020156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:20.020594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:20.021468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:20.021922 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:20.022345 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:20.036369 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] HTTP exception thrown: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Request method failure captured: Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 HTTP/1.1 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BI8a1r0ISxKjp_9sED_nEaT575TBZ9rLXOPZDrP3raCX9eicW92rK3_oC3s-sL-1dRQ268LMvqYOcZQVxyA7jLlVOJytJU-i9cwlZxjxEWqTOcvfDJ_-ba4weSfwuOgGZIJIk6IvCyMvbA8YQAQbIQfIVunRRwIxNYYQp0XvClkkl8 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:31:20.038066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12435b63a424deeb1cca3ba959245a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: bb092d77de334d3ab631a42979460c59 Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:31:20.039434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '20345500-7cc0-4cd4-9c7a-35fc42ba4a32'} Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:31:20.040339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:31:20.041741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:20.042793 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Returning 404 to user: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:31:20.042793 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4a40327e-a154-45e4-b5f0-f71050a3b4fc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 404 len: 111 microversion: 2.20 time: 0.032956 Aug 07 19:31:20.042793 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 317/619] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:20 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 19:31:20.048808 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b9788cb5-3296-4e93-870f-d51458a886b8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '.version_select at 0x7fd476c25f70>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:20.069458 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b9788cb5-3296-4e93-870f-d51458a886b8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442231156" status: 204 len: 0 microversion: 2.20 time: 0.024757 Aug 07 19:31:20.070041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 318/620] 10.222.0.17 () {60 vars in 1259 bytes} [Sun Aug 7 19:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442231156 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 07 19:31:20.107970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:20.115912 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fece6d7d-1a24-40cc-9512-7cdd1314a840 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1690 microversion: 2.1 time: 0.168145 Aug 07 19:31:20.116680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 303/621] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:19 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:20.199342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:20.199874 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:20.207592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:20.208109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:20.208559 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:20.209356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:20.209690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:20.210116 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:20.480143 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:20.488217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bf2f9941-9fcd-4979-b254-426efc51edab tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.293275 Aug 07 19:31:20.488846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 319/622] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:20 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:20.518446 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:20.520798 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:20.527403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:20.527876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:20.528336 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:20.529211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:20.529627 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:20.530092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:20.560264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b6c8ef85-2e4d-42cf-a197-51ad33cabbf1 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Aug 07 19:31:20.560835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 304/623] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:20 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:20.808655 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9331b867-785e-4eea-8db8-6c7e9e1e2eb6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'create', calling method: .version_select at 0x7fd476c61040>, body: {"keypair": {"name": "tempest-keypair-764300850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEsD+FsOF48ydCqRduGEXrkRPPMas4wLQqBEaAC40XqeEVAmqz1Cg5REEN9UUXKq3DiFpLZprz28mswjESksuYk9rMgCV7rbWI+D60tL9XhCvvk88ZvanDtTn2j2mqfYA=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:20.824674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9331b867-785e-4eea-8db8-6c7e9e1e2eb6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for project d12435b63a424deeb1cca3ba959245a4. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:31:20.828723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9331b867-785e-4eea-8db8-6c7e9e1e2eb6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for user bb092d77de334d3ab631a42979460c59 and project d12435b63a424deeb1cca3ba959245a4. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:31:20.853240 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9331b867-785e-4eea-8db8-6c7e9e1e2eb6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048563 Aug 07 19:31:20.853833 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 320/624] 10.222.0.17 () {62 vars in 1200 bytes} [Sun Aug 7 19:31:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 19:31:21.136666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:21.137351 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:21.144729 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:21.145301 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:21.145819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:21.146636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:21.147167 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:21.147668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:21.287502 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:21.295901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b17201a5-c508-4745-b8b8-1803ea12b617 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1690 microversion: 2.1 time: 0.162684 Aug 07 19:31:21.296613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 305/625] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:21 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:21.511925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:21.512763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:21.520019 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:21.520437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:21.520873 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:21.521589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:21.522038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:21.522444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:21.572984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:21.576339 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:21.583498 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:21.584219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:21.584636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:21.585663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:21.586117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:21.586639 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:21.620292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aec48111-5ee4-407e-8d9f-1018958b3ef2 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051224 Aug 07 19:31:21.620951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 306/626] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:21 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:21.673586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:21.681564 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-40235d0b-f75a-480f-a5ef-db3c1633687a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.175960 Aug 07 19:31:21.682110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 321/627] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:21 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:22.317633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:22.318267 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:22.324914 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:22.325403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:22.325860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:22.326551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:22.327004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:22.327426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:22.400204 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1912868908", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f692703-83bb-47e7-bf30-c4b2cfe265b0"}], "security_groups": [{"name": "tempest-securitygroup--706291545"}], "key_name": "tempest-keypair-764300850", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:22.463461 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:22.467078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:22.471827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-75c6abe8-f8c4-4995-a94d-9a134594b9ab tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1690 microversion: 2.1 time: 0.158289 Aug 07 19:31:22.472410 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 307/628] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:22 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:22.506237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] validate_networks() for [('9f692703-83bb-47e7-bf30-c4b2cfe265b0', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:31:22.634011 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:22.637405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:22.647089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:22.647580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:22.648038 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:22.648751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:22.649204 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:22.649630 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:22.680086 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ce7be60d-6786-477f-bc08-2b730b289de8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050971 Aug 07 19:31:22.680661 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 308/629] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:22 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:22.702576 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:22.703304 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:22.709989 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:22.710468 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:22.710877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:22.711579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:22.712208 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:22.712665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:22.918405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:22.927094 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-966ec29a-c6c6-4bea-b9f3-6594ef9f2950 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.228322 Aug 07 19:31:22.927883 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 309/630] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:22 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:22.994643 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:31:22.995062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:31:22.995537 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:31:22.995947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:31:22.996465 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:31:23.006104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.006590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.007048 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.007781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.008272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.008697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.025981 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for project d12435b63a424deeb1cca3ba959245a4. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:31:23.030707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Getting quotas for user bb092d77de334d3ab631a42979460c59 and project d12435b63a424deeb1cca3ba959245a4. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:31:23.043120 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:31:23.045910 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:31:23.093521 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e443f8ea-6b26-4727-8e7f-27fae5370a33 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.697665 Aug 07 19:31:23.094178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 322/631] 10.222.0.17 () {62 vars in 1188 bytes} [Sun Aug 7 19:31:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 07 19:31:23.105117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-29dbfc63-f3a2-41f4-879b-b80b0679f6ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:23.105726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-29dbfc63-f3a2-41f4-879b-b80b0679f6ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:23.163603 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-29dbfc63-f3a2-41f4-879b-b80b0679f6ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:23.172926 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-29dbfc63-f3a2-41f4-879b-b80b0679f6ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:23.174420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-29dbfc63-f3a2-41f4-879b-b80b0679f6ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:23.176219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-29dbfc63-f3a2-41f4-879b-b80b0679f6ca tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1281 microversion: 2.20 time: 0.074394 Aug 07 19:31:23.176846 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 310/632] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:23 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:23.493223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:23.493812 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:23.502083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.502744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.503203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.504207 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.504713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.505249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.653757 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:23.662883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2ae023a9-6404-4d32-b09f-26a0389bee06 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1690 microversion: 2.1 time: 0.173946 Aug 07 19:31:23.663855 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 323/633] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:23 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:23.692613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:23.695613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:23.706641 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.707543 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.708175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.709055 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.709726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.710378 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.743611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d0fb6cbb-b9c9-4b30-818b-6359013a8bde tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054891 Aug 07 19:31:23.744234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 311/634] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:23 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:31:23.815805 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:23.816356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:23.823751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.824278 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.824840 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.826329 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.827147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.827823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.857972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:31:23.946996 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c7b9456f-d388-4778-a881-aa0dbc75e618 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 204 len: 0 microversion: 2.1 time: 0.134737 Aug 07 19:31:23.947586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 324/635] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:31:23 2022] DELETE /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:31:23.949465 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:23.950087 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:23.956226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.956416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:23.957049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.957195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:23.957779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.958635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.959238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.959825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.963033 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.963965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.964487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:23.965228 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:23.965676 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:23.966094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:24.174888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:24.179263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:24.184416 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-09b9c0dd-35ce-4623-83c2-7a8936b7bbf2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.238676 Aug 07 19:31:24.185276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 312/636] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:23 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:24.188532 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6af7b283-e47e-4e31-b4a2-c37b155928f7 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1679 microversion: 2.1 time: 0.236544 Aug 07 19:31:24.189102 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 325/637] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:23 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:24.199904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:24.200405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:24.206555 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:24.207257 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:24.207703 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:24.208440 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:24.209277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:24.209385 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:24.275743 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:24.283973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:24.285487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:24.286616 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c7da91dc-672b-4605-8c73-56d0a85f13d0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1333 microversion: 2.20 time: 0.091889 Aug 07 19:31:24.287183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 313/638] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:24 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:31:24.509080 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-a1c8ef2a-8a53-46fa-9db6-e33aa667b043 req-e6764d00-733c-4574-a272-449d42f2fe6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24bc3ee-0e1c-4532-8859-2c6e8a675b3b", "name": "network-vif-deleted", "tag": "7789ece0-abb9-4195-8580-f0706364a37d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:24.519361 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-a1c8ef2a-8a53-46fa-9db6-e33aa667b043 req-e6764d00-733c-4574-a272-449d42f2fe6b service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:24.519836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-a1c8ef2a-8a53-46fa-9db6-e33aa667b043 req-e6764d00-733c-4574-a272-449d42f2fe6b service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:24.520278 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-a1c8ef2a-8a53-46fa-9db6-e33aa667b043 req-e6764d00-733c-4574-a272-449d42f2fe6b service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:24.531629 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-a1c8ef2a-8a53-46fa-9db6-e33aa667b043 req-e6764d00-733c-4574-a272-449d42f2fe6b service nova] Creating event network-vif-deleted:7789ece0-abb9-4195-8580-f0706364a37d for instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b on hv-cinder-85032 Aug 07 19:31:24.537069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-a1c8ef2a-8a53-46fa-9db6-e33aa667b043 req-e6764d00-733c-4574-a272-449d42f2fe6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031656 Aug 07 19:31:24.538083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 326/639] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:24.685400 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:24.686269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:24.692772 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:24.693942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:24.694579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:24.695453 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:24.696096 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:24.696675 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:24.761177 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:24.769114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e415d139-f44e-47b7-a491-5a1c99872072 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1622 microversion: 2.1 time: 0.087594 Aug 07 19:31:24.769696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 314/640] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:24 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:25.210844 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:25.211573 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:25.213637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:25.214208 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:25.218477 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.218955 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.219347 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.220343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.220785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.220927 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.221171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.221286 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.221725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.222391 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.222829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.223244 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.430795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:25.439728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1bad60be-e402-4fee-a8de-9c9379eaed77 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1679 microversion: 2.1 time: 0.230370 Aug 07 19:31:25.440302 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:25.441033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 315/641] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:25 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:25.445920 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:25.446804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:25.450761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6a65c4cf-3c41-4c85-beef-a9583a9c53a9 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.243173 Aug 07 19:31:25.451810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 327/642] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:25 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:25.453949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.454433 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.454864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.455563 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.456030 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.456455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.525971 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:25.534011 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:25.535492 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:25.536648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7430d216-b404-4024-ad2e-d949ba342e83 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1333 microversion: 2.20 time: 0.094437 Aug 07 19:31:25.537195 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 316/643] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:25 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:25.791341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:25.791976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:25.800218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.800774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.801203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.801902 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:25.802346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:25.802765 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:25.874323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:25.882747 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3d03519f-a02a-414a-8255-cd1e51031b93 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1622 microversion: 2.1 time: 0.096076 Aug 07 19:31:25.883324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 328/644] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:25 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:26.461111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:26.461725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:26.468758 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.469306 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.469751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.470477 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.470950 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.471392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.473548 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:26.474263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:26.480575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.481282 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.481866 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.482659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.483193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.483718 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.667817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:26.676620 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:26.676830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b69d0f88-5617-4b20-b252-c200815f1ace tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1679 microversion: 2.1 time: 0.219519 Aug 07 19:31:26.677413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 317/645] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:26 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:26.683031 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:26.683200 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:26.688177 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b3913edc-d299-457e-a389-b3e4877c263f tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.219319 Aug 07 19:31:26.689486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.690205 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.690650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.691322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.691778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.692236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.696052 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 329/646] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:26 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:26.755657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:26.764337 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:26.765956 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:26.767079 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7aa7b44d-8840-4ab2-860e-08cb5ed63f6c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1339 microversion: 2.20 time: 0.088742 Aug 07 19:31:26.767645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 318/647] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:26 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:26.905863 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:26.906479 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:26.915479 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.916669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.916669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.917557 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.918020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.918449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.961279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:26.962615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:26.963172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:26.964060 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lazy-loading 'fault' on Instance uuid d24bc3ee-0e1c-4532-8859-2c6e8a675b3b {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:27.023022 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:27.031795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-203618d3-4e79-4611-9ab4-1b23bd9db427 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 200 len: 1335 microversion: 2.1 time: 0.130773 Aug 07 19:31:27.032416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 330/648] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:26 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 1335 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:27.699470 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:27.700388 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:27.715125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:27.715125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:27.715125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:27.715125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:27.715672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:27.715958 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:27.720408 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:27.721326 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:27.728628 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:27.729135 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:27.729573 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:27.730377 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:27.730772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:27.731199 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:27.954491 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:27.965084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:27.981886 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3e1566db-914d-46d6-999a-9fae634cb615 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.271491 Aug 07 19:31:27.985868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0d18a824-8b5a-46b1-9623-4c9be2a77077 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1679 microversion: 2.1 time: 0.291109 Aug 07 19:31:27.996729 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 319/649] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:27 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:27.996932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:27.997050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 331/650] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:27 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:28.000605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:28.011349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:28.011694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:28.012859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:28.027617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:28.027617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:28.029016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:28.053910 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:28.054532 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: d24bc3ee-0e1c-4532-8859-2c6e8a675b3b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:28.060593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:28.061078 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:28.061510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:28.062459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:28.063077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:28.063672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:28.078846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] HTTP exception thrown: Instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b could not be found. Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Request method failure captured: Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b HTTP/1.1 Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHUMfeFcA0vPGrwcpD6to5-Zis3n4fh-7LM-v1CVIs7l3u3s2eJuzUJybzvMYervGLtni9GY8diy5ko9vV5_IP4WfE29PaoJ24OcBgSzpbd8LA84m8WPg6rCiv4_d1Wt5OeqT-UVubX1pgJV4YSeE4nfCHEXDU4J0aZxILPfucZIl4 Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:31:28.080835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fe60f1637744c3f8a25e83f48bfdf71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: f643fd4ee6bc4ccfae45f3b8523ae46a Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b could not be found. Aug 07 19:31:28.082368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'd24bc3ee-0e1c-4532-8859-2c6e8a675b3b'} Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b could not be found. Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:31:28.083220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b could not be found. Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b could not be found. Aug 07 19:31:28.084617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:28.086608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Returning 404 to user: Instance d24bc3ee-0e1c-4532-8859-2c6e8a675b3b could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:31:28.087617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2917487-4b43-4baf-9d75-2d108eb38ba4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b" status: 404 len: 111 microversion: 2.1 time: 0.037980 Aug 07 19:31:28.088218 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 332/651] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:28 2022] GET /compute/v2.1/servers/d24bc3ee-0e1c-4532-8859-2c6e8a675b3b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 19:31:28.096394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-31df6644-e79f-475f-ae14-37bc5ba3acc2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '.version_select at 0x7fd476c0b790>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:28.101857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:28.115128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:28.117449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:28.118209 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-31df6644-e79f-475f-ae14-37bc5ba3acc2 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262878383" status: 202 len: 0 microversion: 2.1 time: 0.025557 Aug 07 19:31:28.118786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-94597175-cd86-463b-bd3e-c1ea1b62fa72 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1339 microversion: 2.20 time: 0.129046 Aug 07 19:31:28.119469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 333/652] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Aug 7 19:31:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262878383 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 19:31:28.119739 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 320/653] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:27 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:28.634769 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7ca67e25-ceec-478b-b00a-dcdefe395a4b req-0700b2c1-2900-4735-ab2d-1d0f27884cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0", "name": "network-vif-deleted", "tag": "23b8cc87-f2b3-49cd-a6d4-33f1831666b8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:28.655727 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7ca67e25-ceec-478b-b00a-dcdefe395a4b req-0700b2c1-2900-4735-ab2d-1d0f27884cf7 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:28.656610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7ca67e25-ceec-478b-b00a-dcdefe395a4b req-0700b2c1-2900-4735-ab2d-1d0f27884cf7 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:28.657192 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7ca67e25-ceec-478b-b00a-dcdefe395a4b req-0700b2c1-2900-4735-ab2d-1d0f27884cf7 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:28.672253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7ca67e25-ceec-478b-b00a-dcdefe395a4b req-0700b2c1-2900-4735-ab2d-1d0f27884cf7 service nova] Creating event network-vif-deleted:23b8cc87-f2b3-49cd-a6d4-33f1831666b8 for instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 on hv-cinder-85032 Aug 07 19:31:28.677710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7ca67e25-ceec-478b-b00a-dcdefe395a4b req-0700b2c1-2900-4735-ab2d-1d0f27884cf7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046557 Aug 07 19:31:28.678565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 334/654] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:29.010959 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:29.011622 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:29.019169 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:29.020053 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:29.020479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:29.021175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:29.021617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:29.022066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:29.022928 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:29.023802 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:29.031160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:29.031786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:29.032357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:29.033254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:29.033776 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:29.034188 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:29.038911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:29.090609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:29.101138 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11a8896b-bf53-4383-a322-39dbc0b56cc8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 200 len: 1613 microversion: 2.1 time: 0.093828 Aug 07 19:31:29.101826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 321/655] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:29 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:29.141552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:29.142200 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:29.149256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:29.150078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:29.150637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:29.151364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:29.152053 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:29.152484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:29.209801 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:29.218713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b429218f-1c23-4433-b291-806975d69cc2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.205119 Aug 07 19:31:29.220083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 335/656] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:29 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:29.301119 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:29.310769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:29.312377 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:29.313489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fbd8d968-4df1-4254-80f1-a19890417af5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.176084 Aug 07 19:31:29.314047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 322/657] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:29 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:31:30.124167 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:30.125646 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:30.133225 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:30.133839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:30.134530 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:30.135519 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:30.136063 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:30.136553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:30.161378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 HTTP/1.1 Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:31:30.163133 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:31:30.164901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0'} Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:31:30.165669 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:31:30.166918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:30.167970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:31:30.167970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-587ec5f2-88b6-44cc-83d3-25d0bfd8e71a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 404 len: 111 microversion: 2.1 time: 0.045703 Aug 07 19:31:30.167970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 336/658] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:30 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:31:30.175427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2fa3e5ce-8c6a-4034-8103-951ea6c059f4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '.version_select at 0x7fd476ce4af0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:30.196825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2fa3e5ce-8c6a-4034-8103-951ea6c059f4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133531702" status: 202 len: 0 microversion: 2.1 time: 0.025604 Aug 07 19:31:30.197605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 323/659] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Aug 7 19:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133531702 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:31:30.241420 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:30.242034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:30.249569 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:30.250381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:30.250988 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:30.251848 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:30.252751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:30.253166 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:30.337380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:30.338396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:30.352024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:30.353133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:30.353586 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:30.354318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:30.358465 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:30.359022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:30.553603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:30.562365 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ca09d16e-f541-491a-a4ef-c0071eb52124 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.325073 Aug 07 19:31:30.563419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 337/660] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:30 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:30.610717 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:30.621180 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:30.622636 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:30.624199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2734704d-bf53-4e38-8983-8bf42301ed50 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.291567 Aug 07 19:31:30.628055 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 324/661] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:30 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:31:30.693617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-914855b6-3f49-4d9e-8f50-cf73e5a82e1a req-3655ee66-c3d6-4086-b8c2-6fb5ecf99ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd99150-d69e-492b-935e-7ca2d4e55b0b", "tag": "f795fad8-24c5-4844-b5bd-2fd41159afb2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:30.698713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:30.706176 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-914855b6-3f49-4d9e-8f50-cf73e5a82e1a req-3655ee66-c3d6-4086-b8c2-6fb5ecf99ac0 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:30.706691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-914855b6-3f49-4d9e-8f50-cf73e5a82e1a req-3655ee66-c3d6-4086-b8c2-6fb5ecf99ac0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:30.707115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-914855b6-3f49-4d9e-8f50-cf73e5a82e1a req-3655ee66-c3d6-4086-b8c2-6fb5ecf99ac0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:30.721185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-914855b6-3f49-4d9e-8f50-cf73e5a82e1a req-3655ee66-c3d6-4086-b8c2-6fb5ecf99ac0 service nova] Creating event network-changed:f795fad8-24c5-4844-b5bd-2fd41159afb2 for instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b on hv-cinder-85032 Aug 07 19:31:30.726395 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-914855b6-3f49-4d9e-8f50-cf73e5a82e1a req-3655ee66-c3d6-4086-b8c2-6fb5ecf99ac0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036630 Aug 07 19:31:30.726995 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 338/662] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:31.059755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c53bea2f-7c27-4397-bde0-5212c422a105 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: .version_select at 0x7fd476c15ee0>, body: {"keypair": {"name": "tempest-keypair-1375057704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4lunPNtNnsK5ZyxK+xq+KQKxvyal0LgaiZABFQ6BT/OUZMzuJRGnWzVwencNknEpAYTInbkBQD022OCa9aFa9y89YzpiLbfHfV468jl0kp8OOn+XxLWegV7EgR2Jqtqg=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:31.076285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c53bea2f-7c27-4397-bde0-5212c422a105 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:31:31.080582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c53bea2f-7c27-4397-bde0-5212c422a105 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:31:31.109727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c53bea2f-7c27-4397-bde0-5212c422a105 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053860 Aug 07 19:31:31.110331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 325/663] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:31:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:31.184939 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:31.185529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:31.194617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.195109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.195539 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.196267 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.196742 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.197153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.223939 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:31:31.319758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eb5b3fb0-1f82-430a-ad80-6f22d8dbdac1 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "DELETE /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 204 len: 0 microversion: 2.1 time: 0.139305 Aug 07 19:31:31.320424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 339/664] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:31:31 2022] DELETE /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:31:31.329438 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:31.330060 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:31.336259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.336751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.337190 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.337904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.338366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.338890 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.510204 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:31.518431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1461e6be-476b-411d-9619-87d1627c824d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1508 microversion: 2.1 time: 0.193580 Aug 07 19:31:31.519447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 326/665] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:31 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:31.584592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:31.585592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:31.591931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.592438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.593085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.593846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.594288 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.594681 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.648082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:31.648689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:31.654915 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.655392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.655897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.656631 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:31.657221 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:31.657627 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:31.676733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:32.137194 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:32.145263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a8923c4-b66b-4848-972c-043739025a3a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1568 microversion: 2.1 time: 0.565003 Aug 07 19:31:32.145443 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:32.154225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:32.155777 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:32.156944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc425eab-e338-4858-a79d-37bff3fb9ff8 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.513119 Aug 07 19:31:32.157473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 327/666] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:31 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:31:32.160333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 340/667] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:31 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1568 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:32.166811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:32.167433 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:32.174942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:32.175416 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:32.175873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:32.176619 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:32.177073 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:32.177485 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:32.290779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117832) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 19:31:32.384509 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f384c1a5-86d3-451d-9e6c-36ad0cb275ca tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "POST /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6/action" status: 202 len: 0 microversion: 2.1 time: 0.222701 Aug 07 19:31:32.388093 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 328/668] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:31:32 2022] POST /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:31:32.394711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:32.395454 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:32.402435 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:32.403144 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:32.403573 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:32.404990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:32.405633 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:32.406279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:32.540706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:32.541417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:32.548843 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:32.549832 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:32.550420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:32.551589 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:32.552072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:32.552533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:32.655123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:32.662824 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-290a82a3-8908-4dc4-aab3-c300c09712fd tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1516 microversion: 2.1 time: 0.273111 Aug 07 19:31:32.668097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 341/669] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:32 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:32.776378 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:32.784631 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f1c40e0a-22a6-4bb0-b61b-87f89558d7d4 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1508 microversion: 2.1 time: 0.249303 Aug 07 19:31:32.785317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 329/670] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:32 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:33.045255 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1896127815", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc78dd60-2af8-48f0-9dbc-66b27c087d3d"}], "security_groups": [{"name": "tempest-securitygroup--286444087"}], "key_name": "tempest-keypair-1375057704", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:33.054050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:33.055062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=10 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:33.155499 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] validate_networks() for [('fc78dd60-2af8-48f0-9dbc-66b27c087d3d', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:31:33.180145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:33.180838 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:33.186935 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.187516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.187951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.188683 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.189138 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.189558 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.387676 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:33.395961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:33.397495 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:33.398584 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2d6caa20-3887-4a97-9f8f-548f2968e63a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.222560 Aug 07 19:31:33.399174 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 330/671] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:33 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:33.639320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:31:33.639858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:31:33.640397 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:31:33.640954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:31:33.641356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:31:33.651527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.652011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.652461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.653178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.653617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.654027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.672101 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:31:33.676485 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Getting quotas for user be3e2afc428a45e2b993c39e3d53cd8b and project b10e8224d7aa4b019ccad26aa3398933. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:31:33.685816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:33.686610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:33.688867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:31:33.691149 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:31:33.693731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.694216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.694648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.695398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.695888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.696557 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.745217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-61c0129b-408e-4daf-8c67-ffc11e1c5d5b tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704296 Aug 07 19:31:33.745897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 342/672] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:31:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:31:33.757008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-76273005-7225-4eb5-a2bf-15fed0316990 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:33.757616 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-76273005-7225-4eb5-a2bf-15fed0316990 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:33.844687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-76273005-7225-4eb5-a2bf-15fed0316990 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:33.854034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-76273005-7225-4eb5-a2bf-15fed0316990 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1242 microversion: 2.1 time: 0.100926 Aug 07 19:31:33.867466 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 343/673] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:33 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:33.873997 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:33.874695 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:33.882998 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.883603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.884568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.884728 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:33.885088 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:33.885509 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:33.915305 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:33.924243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc757016-5e82-4b4a-ae8b-68889757364a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1516 microversion: 2.1 time: 0.242278 Aug 07 19:31:33.936802 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 331/674] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:33 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:34.071850 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:34.081208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f76a7af-f779-47d7-91db-a6b66ecc0092 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1508 microversion: 2.1 time: 0.210779 Aug 07 19:31:34.081759 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 344/675] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:33 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:34.425547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:34.426138 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:34.436316 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.439020 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.440336 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:34.441331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.442107 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.442739 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:34.595482 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:34.608500 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:34.610116 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:34.611307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4c3f82dc-828b-4acf-a2b4-5565217a9c45 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.193854 Aug 07 19:31:34.618183 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-83d9f199-eb1b-46fc-ba6c-d2a7eae7c735 req-53161ad9-7dc6-439a-bc9e-31593cb9ea87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6", "name": "network-vif-unplugged", "status": "completed", "tag": "a441108c-e43e-4ecc-b113-5e6d2d30de08"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:34.625111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 332/676] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:34 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:34.630615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-83d9f199-eb1b-46fc-ba6c-d2a7eae7c735 req-53161ad9-7dc6-439a-bc9e-31593cb9ea87 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.632056 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-83d9f199-eb1b-46fc-ba6c-d2a7eae7c735 req-53161ad9-7dc6-439a-bc9e-31593cb9ea87 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.634359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-83d9f199-eb1b-46fc-ba6c-d2a7eae7c735 req-53161ad9-7dc6-439a-bc9e-31593cb9ea87 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:34.648599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.compute.server_external_events [req-83d9f199-eb1b-46fc-ba6c-d2a7eae7c735 req-53161ad9-7dc6-439a-bc9e-31593cb9ea87 service nova] Unable to find a host for instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6. Dropping event network-vif-unplugged {{(pid=117833) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 19:31:34.650337 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-83d9f199-eb1b-46fc-ba6c-d2a7eae7c735 req-53161ad9-7dc6-439a-bc9e-31593cb9ea87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037442 Aug 07 19:31:34.651009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 345/677] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 19:31:34.838951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-fb48d2c7-359e-4518-8c07-44b11608a3dc req-88232caa-0b14-4f20-9199-fb237b4f9694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280a2b69-299a-4b09-97df-07cc251437a7", "name": "network-vif-deleted", "tag": "872ec0ba-2832-4ac2-8bfe-ef80b10fb5af"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:34.844994 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:34.848895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fb48d2c7-359e-4518-8c07-44b11608a3dc req-88232caa-0b14-4f20-9199-fb237b4f9694 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.849374 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fb48d2c7-359e-4518-8c07-44b11608a3dc req-88232caa-0b14-4f20-9199-fb237b4f9694 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.849800 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fb48d2c7-359e-4518-8c07-44b11608a3dc req-88232caa-0b14-4f20-9199-fb237b4f9694 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:34.862072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-fb48d2c7-359e-4518-8c07-44b11608a3dc req-88232caa-0b14-4f20-9199-fb237b4f9694 service nova] Creating event network-vif-deleted:872ec0ba-2832-4ac2-8bfe-ef80b10fb5af for instance 280a2b69-299a-4b09-97df-07cc251437a7 on hv-cinder-85032 Aug 07 19:31:34.867158 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-fb48d2c7-359e-4518-8c07-44b11608a3dc req-88232caa-0b14-4f20-9199-fb237b4f9694 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Aug 07 19:31:34.868103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 333/678] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:34.882320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:34.885804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:34.897677 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.898433 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.898983 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:34.900092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.901257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.901710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:34.951530 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:34.952848 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:34.961000 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.961562 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.962155 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:34.963190 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:34.964065 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:34.964508 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:35.001530 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:35.009930 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9e7b8452-d70c-43d1-89a3-3289e0adaee4 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1294 microversion: 2.1 time: 0.137926 Aug 07 19:31:35.024974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 346/679] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:34 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1294 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:35.101579 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:35.102104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:35.108575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:35.109786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:35.110224 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:35.111293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:35.111912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:35.112360 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:35.144447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:35.156548 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da9afb64-6a6a-4b25-9ba8-4a3fc2f27fba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1518 microversion: 2.1 time: 0.212457 Aug 07 19:31:35.158201 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:35.173906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 334/680] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:34 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:35.175215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:35.175743 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:35.176259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lazy-loading 'fault' on Instance uuid 280a2b69-299a-4b09-97df-07cc251437a7 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:35.220929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:35.229339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3fdd38b7-18e1-48a3-9652-9f38acd9e0d3 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 200 len: 1311 microversion: 2.1 time: 0.131656 Aug 07 19:31:35.230775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 347/681] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:35 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:35.635234 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:35.636633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:35.643818 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:35.644382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:35.644863 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:35.645769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:35.647292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:35.647727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:35.781893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:35.790149 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:35.791755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:35.793000 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-85218498-69d1-4f76-b4d6-1c5f735739d2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.161978 Aug 07 19:31:35.793678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 335/682] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:35 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:36.031129 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:36.031983 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:36.038914 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.039399 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.039866 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.040597 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.041773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.041773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.181287 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:36.182179 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:36.190040 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.190570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.191016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.191739 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.192228 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.192651 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.193888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:36.205260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b759693e-56dd-43de-9a67-c66a3a06d94e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.178110 Aug 07 19:31:36.206473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 348/683] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:36 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:36.250755 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:36.251675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 280a2b69-299a-4b09-97df-07cc251437a7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:36.258097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.258828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.259445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.260383 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.261029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.261640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.282385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] HTTP exception thrown: Instance 280a2b69-299a-4b09-97df-07cc251437a7 could not be found. Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Request method failure captured: Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 HTTP/1.1 Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHUMfeFcA0vPGrwcpD6to5-Zis3n4fh-7LM-v1CVIs7l3u3s2eJuzUJybzvMYervGLtni9GY8diy5ko9vV5_IP4WfE29PaoJ24OcBgSzpbd8LA84m8WPg6rCiv4_d1Wt5OeqT-UVubX1pgJV4YSeE4nfCHEXDU4J0aZxILPfucZIl4 Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:31:36.284114 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fe60f1637744c3f8a25e83f48bfdf71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: f643fd4ee6bc4ccfae45f3b8523ae46a Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 280a2b69-299a-4b09-97df-07cc251437a7 could not be found. Aug 07 19:31:36.285567 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '280a2b69-299a-4b09-97df-07cc251437a7'} Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280a2b69-299a-4b09-97df-07cc251437a7 could not be found. Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:31:36.286378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280a2b69-299a-4b09-97df-07cc251437a7 could not be found. Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280a2b69-299a-4b09-97df-07cc251437a7 could not be found. Aug 07 19:31:36.287622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:31:36.288815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Returning 404 to user: Instance 280a2b69-299a-4b09-97df-07cc251437a7 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:31:36.288815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-11e8a7d7-fad9-400d-a1a3-7b52ecf3e984 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7" status: 404 len: 111 microversion: 2.1 time: 0.038870 Aug 07 19:31:36.288815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 349/684] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:36 2022] GET /compute/v2.1/servers/280a2b69-299a-4b09-97df-07cc251437a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:31:36.294217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:36.294713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:36.302108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.302595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.303434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.304536 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.305147 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.305728 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.338324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:31:36.373222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:36.383901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b8ae51df-0baf-4ab2-a97c-57fa5250254a tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.205227 Aug 07 19:31:36.384878 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 336/685] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:36 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:36.446676 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2c86fe4c-bce1-4cdf-8e1e-191c8a88bf44 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 204 len: 0 microversion: 2.1 time: 0.155794 Aug 07 19:31:36.447867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 350/686] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:31:36 2022] DELETE /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 19:31:36.456514 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:36.457633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:36.464302 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.464849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.465216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.465921 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.466370 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.466772 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.613314 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:36.621070 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-39719abf-1ac5-4c78-a76a-cc7dcbe708b7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.168587 Aug 07 19:31:36.622013 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 337/687] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:36 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:36.667702 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-c4b81d78-7646-4c8c-b6cc-c47ed429f45e req-cd776f40-b36b-49bc-9207-e34eb8bff4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd99150-d69e-492b-935e-7ca2d4e55b0b", "name": "network-vif-plugged", "status": "completed", "tag": "f795fad8-24c5-4844-b5bd-2fd41159afb2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:36.678045 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-c4b81d78-7646-4c8c-b6cc-c47ed429f45e req-cd776f40-b36b-49bc-9207-e34eb8bff4cf service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.678673 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-c4b81d78-7646-4c8c-b6cc-c47ed429f45e req-cd776f40-b36b-49bc-9207-e34eb8bff4cf service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.679198 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-c4b81d78-7646-4c8c-b6cc-c47ed429f45e req-cd776f40-b36b-49bc-9207-e34eb8bff4cf service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.698284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-c4b81d78-7646-4c8c-b6cc-c47ed429f45e req-cd776f40-b36b-49bc-9207-e34eb8bff4cf service nova] Creating event network-vif-plugged:f795fad8-24c5-4844-b5bd-2fd41159afb2 for instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b on hv-cinder-85032 Aug 07 19:31:36.703352 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-c4b81d78-7646-4c8c-b6cc-c47ed429f45e req-cd776f40-b36b-49bc-9207-e34eb8bff4cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039707 Aug 07 19:31:36.703956 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 351/688] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:36.816423 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:36.818033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:36.825104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.825591 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.826034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.826736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:36.827189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:36.827649 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:36.959609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:36.969050 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:36.970917 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:36.972202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a43ad658-5384-47a4-9861-975b622b8a95 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.159892 Aug 07 19:31:36.972744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 338/689] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:36 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:37.058758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-242a348c-4295-4d90-9683-489cf08d53c9 req-d6cce55b-094f-4db8-b5be-b10fd3e6e950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7650b6-ba15-4820-a6d4-433b96dda30b", "tag": "e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:37.073216 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-242a348c-4295-4d90-9683-489cf08d53c9 req-d6cce55b-094f-4db8-b5be-b10fd3e6e950 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:37.073905 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-242a348c-4295-4d90-9683-489cf08d53c9 req-d6cce55b-094f-4db8-b5be-b10fd3e6e950 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:37.074416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-242a348c-4295-4d90-9683-489cf08d53c9 req-d6cce55b-094f-4db8-b5be-b10fd3e6e950 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:37.086317 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-242a348c-4295-4d90-9683-489cf08d53c9 req-d6cce55b-094f-4db8-b5be-b10fd3e6e950 service nova] Creating event network-changed:e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e for instance ef7650b6-ba15-4820-a6d4-433b96dda30b on hv-cinder-85032 Aug 07 19:31:37.092148 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-242a348c-4295-4d90-9683-489cf08d53c9 req-d6cce55b-094f-4db8-b5be-b10fd3e6e950 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107144 Aug 07 19:31:37.092863 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 352/690] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:31:37.230709 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:37.231723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:37.239137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:37.239630 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:37.240086 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:37.240790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:37.241248 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:37.241665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:37.392731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:37.400944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1616a1ad-610e-4afb-8013-0b7419a2b4bf tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.177275 Aug 07 19:31:37.401471 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 339/691] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:37 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:37.406984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:37.407739 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:37.414344 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:37.415043 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:37.415703 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:37.416780 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:37.417260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:37.417679 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:37.557839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:37.561141 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:37.568838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c4a6abbb-c9ed-47ef-9b47-ab7697cf624d tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.166121 Aug 07 19:31:37.569411 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 353/692] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:37 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:37.645871 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:37.646513 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:37.654519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:37.655115 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:37.655684 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:37.656505 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:37.656968 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:37.657393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:37.808068 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:37.820372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a381b6c-1342-4842-84c2-564039b1e28d tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.180065 Aug 07 19:31:37.821404 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 340/693] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:37 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:37.997853 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:37.998568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:38.007918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.008541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.009023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.010098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.010754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.011272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.150124 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:38.162570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:38.164885 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:38.166339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d0403f2a-a361-4820-95a7-29b52873b3c7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.173855 Aug 07 19:31:38.167177 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 354/694] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:37 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:38.424222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:38.425065 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:38.435232 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.436061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.436529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.437532 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.437979 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.438398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.584524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:38.591034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:38.591672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:38.592640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a166c87c-8cc5-42c5-8ea5-2b58e0fc42a9 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.174381 Aug 07 19:31:38.593450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 341/695] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:38 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:38.597767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.598226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.598657 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.599342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.599775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.600223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.738631 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:38.750610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c99f367c-5939-4e1f-abfa-05ede88c5dff tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.163310 Aug 07 19:31:38.751464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 355/696] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:38 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:38.846691 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:38.847277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:38.853890 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.854392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.854910 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.855902 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:38.856611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:38.857254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:38.992639 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:39.000903 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-30fe14bb-7c9c-404a-a254-83e1442f02f7 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.158143 Aug 07 19:31:39.001481 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 342/697] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:38 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:39.191107 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:39.191662 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:39.198793 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:39.199330 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:39.199751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:39.200466 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:39.200911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:39.201343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:39.348733 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:39.360525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:39.361968 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:39.363045 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-628bbca0-6f3c-4eb9-b722-3d33b67acff3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.176219 Aug 07 19:31:39.363629 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 356/698] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:39 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:39.614071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:39.614687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:39.621289 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:39.621772 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:39.622205 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:39.622898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:39.623364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:39.623789 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:39.759264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:39.762856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:39.767491 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ff89bd0a-d95a-4289-acf1-6909d0e4a9fc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.157451 Aug 07 19:31:39.768093 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 343/699] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:39 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:39.779145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:39.779876 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:39.786559 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:39.787117 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:39.787586 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:39.788382 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:39.788892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:39.789372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:39.930140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:39.938685 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a8313aec-aa5d-406d-a05f-1684fa0dadba tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.163277 Aug 07 19:31:39.939242 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 357/700] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:39 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:40.022359 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:40.022940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:40.030035 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.030562 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.031125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.031845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.032328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.032756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.171787 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:40.180175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dd98e226-9758-4454-944d-23e1d6e3a194 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1522 microversion: 2.1 time: 0.161705 Aug 07 19:31:40.180758 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 344/701] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:40 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:40.386085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:40.386729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:40.394478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.394966 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.395396 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.396549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.397308 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.397713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.533851 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:40.542168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:40.543707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:40.544873 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-07c28a36-836f-4f2e-969c-04a45972fbd6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.162847 Aug 07 19:31:40.545764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 358/702] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:40 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:40.741657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-4c8f8d79-ee93-428c-b884-ddadf2fee1fd req-67df2494-5727-4cd0-950a-49a65c75b1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acd4751-94cc-4386-8cfc-e47567370bae", "name": "network-vif-deleted", "tag": "55fc6e17-2465-45a4-a50b-0bf3ff58fe40"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:40.755398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4c8f8d79-ee93-428c-b884-ddadf2fee1fd req-67df2494-5727-4cd0-950a-49a65c75b1f9 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.755865 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4c8f8d79-ee93-428c-b884-ddadf2fee1fd req-67df2494-5727-4cd0-950a-49a65c75b1f9 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.756333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4c8f8d79-ee93-428c-b884-ddadf2fee1fd req-67df2494-5727-4cd0-950a-49a65c75b1f9 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.767913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-4c8f8d79-ee93-428c-b884-ddadf2fee1fd req-67df2494-5727-4cd0-950a-49a65c75b1f9 service nova] Creating event network-vif-deleted:55fc6e17-2465-45a4-a50b-0bf3ff58fe40 for instance 5acd4751-94cc-4386-8cfc-e47567370bae on hv-cinder-85032 Aug 07 19:31:40.772820 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-4c8f8d79-ee93-428c-b884-ddadf2fee1fd req-67df2494-5727-4cd0-950a-49a65c75b1f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034918 Aug 07 19:31:40.773401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 345/703] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:40.788391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:40.788989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:40.795030 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.795857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.796335 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.797089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.797529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.797940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.948618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:40.957254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e0e091aa-925d-43d3-bfb4-2afce2909302 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.172658 Aug 07 19:31:40.957732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 359/704] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:40 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:40.964546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:40.965451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:40.972319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.972825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.973373 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:40.974072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:40.974511 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:40.974942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:41.088395 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:41.120503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:41.130010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3aafedb-6692-472c-bbe5-c6404a816413 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.170834 Aug 07 19:31:41.130274 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 346/705] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:40 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:41.202031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:41.202622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:41.209157 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:41.209640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:41.210070 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:41.210739 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:41.211205 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:41.211626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:41.274731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:41.282562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ce908d7c-e687-47f9-a46b-0be987fa0376 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1307 microversion: 2.1 time: 0.084473 Aug 07 19:31:41.283132 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 360/706] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:41 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1307 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:41.567400 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:41.568022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:41.574368 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:41.574839 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:41.575270 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:41.575931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:41.576406 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:41.576819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:41.711281 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:41.719932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:41.721400 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:41.722568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-229c9599-efb6-4e43-ba54-bfb01a36fa28 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1406 microversion: 2.20 time: 0.159310 Aug 07 19:31:41.723134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 347/707] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:41 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:41.979017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:41.979556 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:41.986532 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:41.987031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:41.987453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:41.988171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:41.988614 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:41.989009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.127315 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:42.138257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-30d6eb82-918b-4969-b7a5-2fcef0d524c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.162968 Aug 07 19:31:42.139119 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 361/708] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:41 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:42.150906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:42.151520 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:42.159891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.160413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.160844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.161538 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.161989 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.162409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.302289 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:42.303388 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:42.304017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:42.310090 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6b8fdc3-5ec4-4837-af1c-654e2a572e90 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.163127 Aug 07 19:31:42.310268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.310599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.316175 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.316346 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 348/709] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:42 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:42.316615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.316615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.316615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.345561 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.346026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.346466 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.346912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lazy-loading 'fault' on Instance uuid 5acd4751-94cc-4386-8cfc-e47567370bae {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:31:42.397643 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f643fd4ee6bc4ccfae45f3b8523ae46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe60f1637744c3f8a25e83f48bfdf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:42.407018 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7032483e-b971-41e8-be9e-a8b505395436 tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 200 len: 1312 microversion: 2.1 time: 0.107758 Aug 07 19:31:42.407614 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 362/710] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:42 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:42.745819 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:42.746420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:42.753109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.753596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.754030 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.754728 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.755178 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.755596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.900551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:42.909012 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:42.910524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:42.911673 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dd06cbd9-b43d-4b61-a3aa-0d34cc309b56 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1598 microversion: 2.20 time: 0.169899 Aug 07 19:31:42.912333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 349/711] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:31:42 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:31:42.934027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:42.934519 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:42.941073 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.941573 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.942008 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:42.942720 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:42.943176 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:42.943618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:43.023559 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-61c80569-39bd-435e-98e1-477170f76a88 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093434 Aug 07 19:31:43.024210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 363/712] 10.222.0.17 () {60 vars in 1316 bytes} [Sun Aug 7 19:31:42 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:31:43.159051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:43.159730 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:43.166484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:43.166976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:43.167418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:43.168182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:43.168637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:43.169066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:43.330877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:43.331473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:43.338327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:43.338989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:43.339576 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:43.340332 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:43.340790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:43.341213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:43.476867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:43.484983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-40b5569b-0e3d-4645-a6e1-7e3622ead5ee tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.329896 Aug 07 19:31:43.485588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 350/713] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:43 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:43.490439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:43.491064 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] [instance: 5acd4751-94cc-4386-8cfc-e47567370bae] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:43.497688 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:43.498211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:43.498889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:43.499731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:43.500246 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:43.500671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:43.514721 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] HTTP exception thrown: Instance 5acd4751-94cc-4386-8cfc-e47567370bae could not be found. Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Request method failure captured: Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae HTTP/1.1 Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHUMfeFcA0vPGrwcpD6to5-Zis3n4fh-7LM-v1CVIs7l3u3s2eJuzUJybzvMYervGLtni9GY8diy5ko9vV5_IP4WfE29PaoJ24OcBgSzpbd8LA84m8WPg6rCiv4_d1Wt5OeqT-UVubX1pgJV4YSeE4nfCHEXDU4J0aZxILPfucZIl4 Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:31:43.516580 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0fe60f1637744c3f8a25e83f48bfdf71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0fe60f1637744c3f8a25e83f48bfdf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fe60f1637744c3f8a25e83f48bfdf71 Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1854357956 Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: f643fd4ee6bc4ccfae45f3b8523ae46a Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1854357956-project Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 5acd4751-94cc-4386-8cfc-e47567370bae could not be found. Aug 07 19:31:43.517934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '5acd4751-94cc-4386-8cfc-e47567370bae'} Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5acd4751-94cc-4386-8cfc-e47567370bae could not be found. Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:31:43.518664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5acd4751-94cc-4386-8cfc-e47567370bae could not be found. Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5acd4751-94cc-4386-8cfc-e47567370bae could not be found. Aug 07 19:31:43.520033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:31:43.521075 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] Returning 404 to user: Instance 5acd4751-94cc-4386-8cfc-e47567370bae could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:31:43.521075 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-02dd36db-dd83-484b-aa94-0b1241a70c3a tempest-ServerRescueNegativeTestJSON-1854357956 tempest-ServerRescueNegativeTestJSON-1854357956-project] 10.222.0.17 "GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae" status: 404 len: 111 microversion: 2.1 time: 0.031443 Aug 07 19:31:43.521075 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 351/714] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:43 2022] GET /compute/v2.1/servers/5acd4751-94cc-4386-8cfc-e47567370bae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:31:43.616396 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:43.625056 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7e510d1d-4238-4c83-8bf4-dd68d200230e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.298053 Aug 07 19:31:43.625645 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 364/715] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:43 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:44.466183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f01dae86-8b78-4ac2-8d1b-34e79dd1bb67 req-ea73e7ba-9ae1-41db-b093-53fc1b7493b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd99150-d69e-492b-935e-7ca2d4e55b0b", "tag": "f795fad8-24c5-4844-b5bd-2fd41159afb2"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:44.477503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f01dae86-8b78-4ac2-8d1b-34e79dd1bb67 req-ea73e7ba-9ae1-41db-b093-53fc1b7493b8 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:44.478442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f01dae86-8b78-4ac2-8d1b-34e79dd1bb67 req-ea73e7ba-9ae1-41db-b093-53fc1b7493b8 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:44.479067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f01dae86-8b78-4ac2-8d1b-34e79dd1bb67 req-ea73e7ba-9ae1-41db-b093-53fc1b7493b8 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:44.498625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f01dae86-8b78-4ac2-8d1b-34e79dd1bb67 req-ea73e7ba-9ae1-41db-b093-53fc1b7493b8 service nova] Creating event network-changed:f795fad8-24c5-4844-b5bd-2fd41159afb2 for instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b on hv-cinder-85032 Aug 07 19:31:44.506000 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f01dae86-8b78-4ac2-8d1b-34e79dd1bb67 req-ea73e7ba-9ae1-41db-b093-53fc1b7493b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124044 Aug 07 19:31:44.506254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:44.506868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:44.507909 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 352/716] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:44.514264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:44.518367 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=8 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:44.522992 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:44.524101 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:44.524882 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:44.525810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:44.526474 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:44.527200 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:44.710801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:44.714347 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:44.724096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-716f27f3-4fb7-45cf-9d2a-6592d20309c3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.220603 Aug 07 19:31:44.724749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:44.736873 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 365/717] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:44 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:44.742833 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:44.743779 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:44.747324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:44.753272 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:44.755123 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:44.762829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:44.765150 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:44.766009 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:44.772984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:44.776257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:44.777846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:44.778836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:44.782260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:44.782978 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:44.849097 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-908c9067-b63b-4885-845f-bbcb7ba7fbcf tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/ips" status: 200 len: 146 microversion: 2.1 time: 0.260701 Aug 07 19:31:44.853725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 353/718] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:31:44 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/ips => generated 146 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:44.993932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:45.003016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6f115731-521d-43ef-9de4-a48e36b38230 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.264238 Aug 07 19:31:45.003642 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 366/719] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:44 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:45.747444 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:45.749006 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:45.755861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:45.756516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:45.756995 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:45.757831 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:45.758294 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:45.758705 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:45.902457 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:45.914843 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d8903974-06e2-4fc4-a204-36e63bc77651 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.172548 Aug 07 19:31:45.915451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 354/720] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:45 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:46.028516 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:46.029097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:46.036623 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:46.037202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:46.037702 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:46.038482 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:46.039005 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:46.039496 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:46.184583 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:46.192151 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-53965a5f-6b93-49f6-b67a-9c4c6e36e233 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.167565 Aug 07 19:31:46.192700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 367/721] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:46 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:46.279263 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17ed2932-d7c2-43f6-addf-bdf1769d1a7a"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:46.283072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:46.289605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:46.290103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:46.290641 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:46.291744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:46.292428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:46.293346 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:46.637249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-168820b0-995c-4649-bc91-1c46f5cac961 req-b3f6a468-20da-4c41-b4ca-36f7b9476470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7650b6-ba15-4820-a6d4-433b96dda30b", "name": "network-vif-plugged", "status": "completed", "tag": "e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:46.659441 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-168820b0-995c-4649-bc91-1c46f5cac961 req-b3f6a468-20da-4c41-b4ca-36f7b9476470 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:46.660254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-168820b0-995c-4649-bc91-1c46f5cac961 req-b3f6a468-20da-4c41-b4ca-36f7b9476470 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:46.660883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-168820b0-995c-4649-bc91-1c46f5cac961 req-b3f6a468-20da-4c41-b4ca-36f7b9476470 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:46.675939 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-168820b0-995c-4649-bc91-1c46f5cac961 req-b3f6a468-20da-4c41-b4ca-36f7b9476470 service nova] Creating event network-vif-plugged:e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e for instance ef7650b6-ba15-4820-a6d4-433b96dda30b on hv-cinder-85032 Aug 07 19:31:46.683176 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-168820b0-995c-4649-bc91-1c46f5cac961 req-b3f6a468-20da-4c41-b4ca-36f7b9476470 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049511 Aug 07 19:31:46.684351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 368/722] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:46.936761 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:46.937525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:46.944596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:46.945074 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:46.945504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:46.946301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:46.946639 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:46.947099 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:47.099366 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:47.107829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d235a85c-941b-4cc3-80a4-174bd54b0cbc tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.175808 Aug 07 19:31:47.108836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 369/723] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:46 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:47.214413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:47.215449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:47.222718 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:47.223671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:47.224296 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:47.225221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:47.225859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:47.226633 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:47.350261 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-161df515-a98a-47f3-bfba-8b6aa4f5622f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.076018 Aug 07 19:31:47.351322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 355/724] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:31:46 2022] POST /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments => generated 194 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:47.558121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:47.566211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b8b6f22b-4176-4c4a-a38f-1e36cffebca6 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.356521 Aug 07 19:31:47.566975 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 370/725] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:47 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:48.131126 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:48.132254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:48.138778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:48.139272 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:48.139756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:48.140486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:48.140988 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:48.141415 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:48.281587 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:48.289818 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-52e322f4-a92f-431d-b08a-679f84c21489 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1367 microversion: 2.1 time: 0.162722 Aug 07 19:31:48.290598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 356/726] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:48 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:48.589511 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:48.590301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:48.593223 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:48.599748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:48.600357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:48.600861 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:48.601668 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:48.602245 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:48.602733 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:48.606824 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:48.765752 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:48.779535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2afa07b8-5728-4926-85cd-e62f30489bd3 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.194064 Aug 07 19:31:48.780167 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 371/727] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:48 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:31:49.311132 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:49.311788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:49.323301 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:49.324432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:49.324901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:49.326566 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:49.327118 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:49.327609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:49.480737 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:49.488200 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2c2e92aa-ee42-4380-b874-c53aed2663c6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1556 microversion: 2.1 time: 0.181188 Aug 07 19:31:49.488763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 357/728] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:49 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:49.508854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:49.509348 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:49.515602 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:49.516115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:49.516928 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:49.517649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:49.518100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:49.518527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:49.609610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-98094bd0-e515-4c16-88ee-b8b16c5d5623 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104722 Aug 07 19:31:49.610538 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 372/729] 10.222.0.17 () {58 vars in 1275 bytes} [Sun Aug 7 19:31:49 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:49.805083 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:49.806618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:49.817476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:49.819160 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:49.820171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:49.821264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:49.821934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:49.822593 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:49.996610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:50.010715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-90005f3e-99ea-4261-b89d-d1e2319e2415 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.213238 Aug 07 19:31:50.014721 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 358/730] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:49 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:50.672607 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-21a724fb-1d6a-42d6-92e1-cab30bcc075e req-f58c1b06-781d-4e03-9cb0-04b489d8ca0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7650b6-ba15-4820-a6d4-433b96dda30b", "tag": "e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:50.684144 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-21a724fb-1d6a-42d6-92e1-cab30bcc075e req-f58c1b06-781d-4e03-9cb0-04b489d8ca0e service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:50.684929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-21a724fb-1d6a-42d6-92e1-cab30bcc075e req-f58c1b06-781d-4e03-9cb0-04b489d8ca0e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:50.685541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-21a724fb-1d6a-42d6-92e1-cab30bcc075e req-f58c1b06-781d-4e03-9cb0-04b489d8ca0e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:50.700742 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-21a724fb-1d6a-42d6-92e1-cab30bcc075e req-f58c1b06-781d-4e03-9cb0-04b489d8ca0e service nova] Creating event network-changed:e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e for instance ef7650b6-ba15-4820-a6d4-433b96dda30b on hv-cinder-85032 Aug 07 19:31:50.710950 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-21a724fb-1d6a-42d6-92e1-cab30bcc075e req-f58c1b06-781d-4e03-9cb0-04b489d8ca0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051451 Aug 07 19:31:50.712387 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 373/731] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:50.714210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-7ae09a76-648d-4273-8b3f-caaab26d0b8c req-54ece535-f07f-443d-91d0-5566c9952dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6", "name": "network-vif-plugged", "status": "completed", "tag": "a441108c-e43e-4ecc-b113-5e6d2d30de08"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:50.728071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7ae09a76-648d-4273-8b3f-caaab26d0b8c req-54ece535-f07f-443d-91d0-5566c9952dbf service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:50.728071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7ae09a76-648d-4273-8b3f-caaab26d0b8c req-54ece535-f07f-443d-91d0-5566c9952dbf service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:50.728431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7ae09a76-648d-4273-8b3f-caaab26d0b8c req-54ece535-f07f-443d-91d0-5566c9952dbf service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:50.742579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-7ae09a76-648d-4273-8b3f-caaab26d0b8c req-54ece535-f07f-443d-91d0-5566c9952dbf service nova] Creating event network-vif-plugged:a441108c-e43e-4ecc-b113-5e6d2d30de08 for instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 on hv-cinder-85032 Aug 07 19:31:50.748268 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-7ae09a76-648d-4273-8b3f-caaab26d0b8c req-54ece535-f07f-443d-91d0-5566c9952dbf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039645 Aug 07 19:31:50.749597 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 359/732] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:50.793077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:50.798035 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:50.806813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:50.807671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:50.808396 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:50.809403 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:50.810055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:50.810758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:50.862731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f9249a9a-e61b-48bc-b758-fa237130eb1b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074910 Aug 07 19:31:50.863767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 374/733] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:31:50 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:50.877158 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:50.878233 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:50.885206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:50.886120 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:50.886657 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:50.887579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:50.888262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:50.888983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:50.922156 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-62c49d29-759c-4378-b8a5-55f4fb7dd97e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/17ed2932-d7c2-43f6-addf-bdf1769d1a7a" status: 200 len: 194 microversion: 2.1 time: 0.051156 Aug 07 19:31:50.923090 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 360/734] 10.222.0.17 () {58 vars in 1413 bytes} [Sun Aug 7 19:31:50 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/17ed2932-d7c2-43f6-addf-bdf1769d1a7a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:51.034707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:51.035318 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:51.043892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:51.044554 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:51.046812 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:51.047564 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:51.048072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:51.049004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:51.230961 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:51.268137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47288322-b95b-4e27-9d22-3b2aab9f5988 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.237254 Aug 07 19:31:51.268843 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 375/735] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:51 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:52.291958 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:52.292635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:52.299934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:52.300437 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:52.300874 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:52.301605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:52.302057 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:52.302536 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:52.414744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e61f25c0-55f2-4602-9854-3d19f86cadca"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:31:52.418512 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:52.427042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:52.427711 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:52.428256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:52.428978 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:52.429510 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:52.430088 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:52.501439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:52.510429 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-76b42bb5-1889-4e4e-ac81-da093b6d98b2 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1574 microversion: 2.1 time: 0.224098 Aug 07 19:31:52.511009 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 361/736] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:52 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:31:53.032333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-327e18c1-69f5-485e-bc08-899810e6a00b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "POST /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622224 Aug 07 19:31:53.032980 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 376/737] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:31:52 2022] POST /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:31:53.531280 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:31:53.532430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:31:53.539179 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:53.539731 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:53.540200 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:53.540905 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:31:53.541326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:31:53.541742 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:31:53.546474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:53.688010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:31:53.695954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bae18c54-69d0-445d-b21e-1c8a7ed74295 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1561 microversion: 2.1 time: 0.168657 Aug 07 19:31:53.696544 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 362/738] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:31:53 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:00.611956 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:00.614334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:00.621343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:00.621820 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:00.622329 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:00.622937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:00.623385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:00.623803 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:00.653186 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-33f1f478-9e64-4195-9cbd-2dbd1f1949ec tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046348 Aug 07 19:32:00.653737 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 377/739] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:32:00 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:00.800466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:00.801036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:00.809299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:00.809917 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:00.810673 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:00.811956 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:00.813055 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:00.813804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:00.847421 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3332abc1-3ea2-449c-8e16-41a5be8886dc tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/17ed2932-d7c2-43f6-addf-bdf1769d1a7a" status: 200 len: 194 microversion: 2.1 time: 0.053153 Aug 07 19:32:00.848029 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 363/740] 10.222.0.17 () {58 vars in 1413 bytes} [Sun Aug 7 19:32:00 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/17ed2932-d7c2-43f6-addf-bdf1769d1a7a => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:00.858659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:00.859146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:00.865838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:00.866317 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:00.866749 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:00.867436 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:00.867888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:00.868342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:00.950643 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lazy-loading 'services' on Instance uuid 320fcd14-0960-44e8-9260-0a6b55a27c94 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:32:01.029772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2596b976-8210-40ce-9ecc-0fdfa9aee695 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/17ed2932-d7c2-43f6-addf-bdf1769d1a7a" status: 202 len: 0 microversion: 2.1 time: 0.174847 Aug 07 19:32:01.030447 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 378/741] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:32:00 2022] DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/17ed2932-d7c2-43f6-addf-bdf1769d1a7a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:32:03.210524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:03.211059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:03.217356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:03.217858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:03.218272 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:03.218958 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:03.219409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:03.219892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:03.252327 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-568b720a-ff18-470a-9016-4efb74e96a8b tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/e61f25c0-55f2-4602-9854-3d19f86cadca" status: 200 len: 194 microversion: 2.1 time: 0.045810 Aug 07 19:32:03.252958 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 364/742] 10.222.0.17 () {58 vars in 1413 bytes} [Sun Aug 7 19:32:03 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/e61f25c0-55f2-4602-9854-3d19f86cadca => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:03.264638 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:03.265212 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:03.271797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:03.272327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:03.272771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:03.273453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:03.274100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:03.274753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:03.357386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lazy-loading 'services' on Instance uuid 320fcd14-0960-44e8-9260-0a6b55a27c94 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:32:03.432696 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-669055bf-a12f-42f7-a7a8-22ec8a793062 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/e61f25c0-55f2-4602-9854-3d19f86cadca" status: 202 len: 0 microversion: 2.1 time: 0.172842 Aug 07 19:32:03.433287 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 379/743] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:32:03 2022] DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments/e61f25c0-55f2-4602-9854-3d19f86cadca => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:32:04.607906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:04.610291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:04.617319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:04.617886 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:04.618387 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:04.619198 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:04.619745 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:04.620259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:04.650402 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c822da4a-04fa-4b24-8013-a1346643fea0 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047145 Aug 07 19:32:04.651123 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 365/744] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:32:04 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:32:04.767618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:04.770245 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:04.776487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:04.777086 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:04.777540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:04.778408 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:04.778849 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:04.779266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:04.810104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a2a2e634-7e48-41e8-ad57-db4da35a90a4 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047406 Aug 07 19:32:04.820232 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 380/745] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:32:04 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 19:32:04.877473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:04.877970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:04.887404 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:04.888026 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:04.888502 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:04.889238 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:04.889694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:04.890113 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:04.920942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:32:04.992052 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=67 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:05.010063 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-934f728b-feea-4671-b677-48897aaeee17 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 204 len: 0 microversion: 2.1 time: 0.136436 Aug 07 19:32:05.011044 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 366/746] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:04 2022] DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:32:05.020410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:05.021012 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:05.026958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:05.027493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:05.027861 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:05.028581 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:05.029031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:05.029443 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:05.168335 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:05.176726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3453a489-d07a-48fd-a1e5-200f6fee7157 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1673 microversion: 2.1 time: 0.160490 Aug 07 19:32:05.177306 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 381/747] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:05 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:06.198897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:06.199605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:06.206168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:06.206642 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:06.207077 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:06.207777 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:06.208353 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:06.208786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:06.357271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:06.365720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-90391694-01f5-4811-92c5-00589b377ac9 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1673 microversion: 2.1 time: 0.171299 Aug 07 19:32:06.366284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 367/748] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:06 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:07.387614 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:07.388385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:07.398407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:07.398407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:07.398407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:07.398407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:07.398965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:07.398965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:07.549604 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:07.557117 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ab8c6e3b-7cd4-41ab-a32a-1679fab6f9e5 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1673 microversion: 2.1 time: 0.173319 Aug 07 19:32:07.557701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 382/749] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:07 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:08.514464 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8761971f-128b-4baa-9a5f-14e0e83bba5e req-7f9e8e0a-8f2f-4dba-b59f-56c53af4b165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320fcd14-0960-44e8-9260-0a6b55a27c94", "name": "network-vif-deleted", "tag": "0dca49b6-5eab-404c-928f-5926020a3172"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:08.528690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8761971f-128b-4baa-9a5f-14e0e83bba5e req-7f9e8e0a-8f2f-4dba-b59f-56c53af4b165 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:08.529246 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8761971f-128b-4baa-9a5f-14e0e83bba5e req-7f9e8e0a-8f2f-4dba-b59f-56c53af4b165 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:08.529881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8761971f-128b-4baa-9a5f-14e0e83bba5e req-7f9e8e0a-8f2f-4dba-b59f-56c53af4b165 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:08.542827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8761971f-128b-4baa-9a5f-14e0e83bba5e req-7f9e8e0a-8f2f-4dba-b59f-56c53af4b165 service nova] Creating event network-vif-deleted:0dca49b6-5eab-404c-928f-5926020a3172 for instance 320fcd14-0960-44e8-9260-0a6b55a27c94 on hv-cinder-85032 Aug 07 19:32:08.549200 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8761971f-128b-4baa-9a5f-14e0e83bba5e req-7f9e8e0a-8f2f-4dba-b59f-56c53af4b165 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038681 Aug 07 19:32:08.550451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 368/750] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:08.580221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:08.580953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:08.589796 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:08.590286 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:08.590718 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:08.595257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:08.595801 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:08.596240 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:08.698872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6732487041c54918b1164b1cb72bb07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf93b388fac4be38661d185a7231937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:08.724355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a67ca06f-fc94-44c5-a31f-9ba7668d541e tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 200 len: 1321 microversion: 2.1 time: 0.149157 Aug 07 19:32:08.725381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 383/751] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:08 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:09.747085 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:09.748183 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:09.754797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:09.755305 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:09.755686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:09.756411 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:09.756856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:09.757270 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:09.770761 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] HTTP exception thrown: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Request method failure captured: Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 HTTP/1.1 Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHWoumIDFpH7LpnnikAU_KFKLvGmVgAeLYgHf5jOYsXuy8SNn_hCexnBtSgftHFTi8kqYedN7n2y6TtdrFD6lhEBiKWFQ2uSnuENtTVwIntYS5Lt7UphUif1BGZ7jLjIvsNL8IAOLWrzNBapJ1qqz7_xS95cpsvpNYN7Za9Vy0TDjA Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:09.772427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf93b388fac4be38661d185a7231937", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf93b388fac4be38661d185a7231937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 6732487041c54918b1164b1cb72bb07e Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:09.775247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '320fcd14-0960-44e8-9260-0a6b55a27c94'} Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:09.776840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:09.779652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:09.782099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Returning 404 to user: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:09.782099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b1aee0f3-f263-4e5c-930f-ebd074b32992 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 404 len: 111 microversion: 2.1 time: 0.030886 Aug 07 19:32:09.782099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 369/752] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:09 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:09.783487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0b99660e-81be-4ce7-adce-a2d999583065 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '.version_select at 0x7fd476bbe1f0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:09.808442 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0b99660e-81be-4ce7-adce-a2d999583065 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872588595" status: 202 len: 0 microversion: 2.1 time: 0.029379 Aug 07 19:32:09.809241 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 384/753] 10.222.0.17 () {58 vars in 1218 bytes} [Sun Aug 7 19:32:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872588595 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 19:32:12.725385 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:12.725951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:12.732936 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:12.733456 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:12.733947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:12.734809 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:12.735334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:12.735895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:12.751097 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] HTTP exception thrown: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Request method failure captured: Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 HTTP/1.1 Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHWoumIDFpH7LpnnikAU_KFKLvGmVgAeLYgHf5jOYsXuy8SNn_hCexnBtSgftHFTi8kqYedN7n2y6TtdrFD6lhEBiKWFQ2uSnuENtTVwIntYS5Lt7UphUif1BGZ7jLjIvsNL8IAOLWrzNBapJ1qqz7_xS95cpsvpNYN7Za9Vy0TDjA Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:12.752945 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf93b388fac4be38661d185a7231937", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf93b388fac4be38661d185a7231937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 6732487041c54918b1164b1cb72bb07e Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.754561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '320fcd14-0960-44e8-9260-0a6b55a27c94'} Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:12.755430 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.756877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.758324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Returning 404 to user: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:12.758324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-977eab21-286e-44ff-ad15-65af3991189f tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 404 len: 111 microversion: 2.1 time: 0.033607 Aug 07 19:32:12.758324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 370/754] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:12 2022] DELETE /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:12.767851 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:12.769095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 320fcd14-0960-44e8-9260-0a6b55a27c94] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:12.775914 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:12.776436 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:12.776895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:12.777590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:12.778074 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:12.778495 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:12.791951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] HTTP exception thrown: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Request method failure captured: Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 HTTP/1.1 Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHWoumIDFpH7LpnnikAU_KFKLvGmVgAeLYgHf5jOYsXuy8SNn_hCexnBtSgftHFTi8kqYedN7n2y6TtdrFD6lhEBiKWFQ2uSnuENtTVwIntYS5Lt7UphUif1BGZ7jLjIvsNL8IAOLWrzNBapJ1qqz7_xS95cpsvpNYN7Za9Vy0TDjA Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:32:12.793656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf93b388fac4be38661d185a7231937", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf93b388fac4be38661d185a7231937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 6732487041c54918b1164b1cb72bb07e Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.795674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '320fcd14-0960-44e8-9260-0a6b55a27c94'} Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:12.796468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. Aug 07 19:32:12.797798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:12.799068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Returning 404 to user: Instance 320fcd14-0960-44e8-9260-0a6b55a27c94 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:12.799068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-df6dc90d-471e-41a6-a20b-8e7607f09199 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94" status: 404 len: 111 microversion: 2.1 time: 0.031906 Aug 07 19:32:12.799068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 385/755] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:12 2022] GET /compute/v2.1/servers/320fcd14-0960-44e8-9260-0a6b55a27c94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 19:32:13.949939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:13.950523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:13.957321 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:13.958040 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:13.959002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:13.959877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:13.960857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:13.961278 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:13.977898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] HTTP exception thrown: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Request method failure captured: Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 HTTP/1.1 Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHWoumIDFpH7LpnnikAU_KFKLvGmVgAeLYgHf5jOYsXuy8SNn_hCexnBtSgftHFTi8kqYedN7n2y6TtdrFD6lhEBiKWFQ2uSnuENtTVwIntYS5Lt7UphUif1BGZ7jLjIvsNL8IAOLWrzNBapJ1qqz7_xS95cpsvpNYN7Za9Vy0TDjA Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:13.979679 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf93b388fac4be38661d185a7231937", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf93b388fac4be38661d185a7231937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 6732487041c54918b1164b1cb72bb07e Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:13.981396 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7'} Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:13.984556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:13.985835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:13.987141 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Returning 404 to user: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:13.987141 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0d193439-b387-4776-9874-43f765bbe293 tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 404 len: 111 microversion: 2.1 time: 0.035120 Aug 07 19:32:13.987141 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 371/756] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:13 2022] DELETE /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:13.990582 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:13.991191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] [instance: 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:13.999062 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:13.999691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:14.000233 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:14.001027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:14.001582 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:14.002028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:14.021160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] HTTP exception thrown: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Request method failure captured: Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 HTTP/1.1 Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHWoumIDFpH7LpnnikAU_KFKLvGmVgAeLYgHf5jOYsXuy8SNn_hCexnBtSgftHFTi8kqYedN7n2y6TtdrFD6lhEBiKWFQ2uSnuENtTVwIntYS5Lt7UphUif1BGZ7jLjIvsNL8IAOLWrzNBapJ1qqz7_xS95cpsvpNYN7Za9Vy0TDjA Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:32:14.022719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf93b388fac4be38661d185a7231937", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf93b388fac4be38661d185a7231937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf93b388fac4be38661d185a7231937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: fcf93b388fac4be38661d185a7231937 Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-568864071 Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 6732487041c54918b1164b1cb72bb07e Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-568864071-project Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:14.024392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7'} Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:14.025589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. Aug 07 19:32:14.027067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:14.028488 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] Returning 404 to user: Instance 4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:14.028488 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-afd47dd7-4594-4d7f-98da-46e6ec7311ef tempest-AttachVolumeTestJSON-568864071 tempest-AttachVolumeTestJSON-568864071-project] 10.222.0.17 "GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7" status: 404 len: 111 microversion: 2.1 time: 0.038155 Aug 07 19:32:14.028488 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 386/757] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:13 2022] GET /compute/v2.1/servers/4bcb9ca6-c179-4e6f-a4c1-7ce77440f6f7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:18.995072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad7b1902-b3f3-4657-b8c9-dd573012aff1 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Action: 'create', calling method: .version_select at 0x7fd476b57af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-353365460", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad7b1902-b3f3-4657-b8c9-dd573012aff1 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Request method failure captured: Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 121 Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BNCHmnnTI5GHDpPxH0N-5zy4-whhi3gxQtLXkTDvLkXuixgwvgfHAOs5m_0rU-6Q-8WlsnrsWYl48VgKic-mfhMdYqCt36w2NiCcvcqj2iEyNArEhW44NX8tHCa9d4lAEIxqT4rFIhIg0rDS-7XZ8s3OYRFrThafneg9GLlXUL_xGc Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:19.007341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b629d01691534ffa8bb750edfd4df96d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 787de57b64a84860bcad23ad72800b0e Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-353365460", "metadata": {"Type": "work"}}} Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: Aug 07 19:32:19.008794 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-353365460', 'metadata': {'Type': 'work'}}}} Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise error Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi '#$%' Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:19.009632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 19:32:19.011285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 19:32:19.012600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 19:32:19.012600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.013512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad7b1902-b3f3-4657-b8c9-dd573012aff1 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:19.015375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad7b1902-b3f3-4657-b8c9-dd573012aff1 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142251 Aug 07 19:32:19.016976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 372/758] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Aug 7 19:32:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:32:19.025786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79b38d18-bc9a-4273-a68b-b48b92615638 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Action: 'create', calling method: .version_select at 0x7fd476c61b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-658320210", "metadata": {"Type": "work"}}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79b38d18-bc9a-4273-a68b-b48b92615638 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Request method failure captured: Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 119 Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BNCHmnnTI5GHDpPxH0N-5zy4-whhi3gxQtLXkTDvLkXuixgwvgfHAOs5m_0rU-6Q-8WlsnrsWYl48VgKic-mfhMdYqCt36w2NiCcvcqj2iEyNArEhW44NX8tHCa9d4lAEIxqT4rFIhIg0rDS-7XZ8s3OYRFrThafneg9GLlXUL_xGc Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:32:19.030606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b629d01691534ffa8bb750edfd4df96d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 787de57b64a84860bcad23ad72800b0e Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-658320210", "metadata": {"Type": "work"}}} Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: Aug 07 19:32:19.032226 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-658320210', 'metadata': {'Type': 'work'}}}} Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise error Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi '0' Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:19.033187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 19:32:19.034967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 19:32:19.037339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 19:32:19.037339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.037339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79b38d18-bc9a-4273-a68b-b48b92615638 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:19.037339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-79b38d18-bc9a-4273-a68b-b48b92615638 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010943 Aug 07 19:32:19.037339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 387/759] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Aug 7 19:32:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 19:32:19.044541 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e9c5ed5-e4fd-4423-ad9e-7e552769d920 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Action: 'create', calling method: .version_select at 0x7fd476b4b0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1278061222", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e9c5ed5-e4fd-4423-ad9e-7e552769d920 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Request method failure captured: Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 119 Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BNCHmnnTI5GHDpPxH0N-5zy4-whhi3gxQtLXkTDvLkXuixgwvgfHAOs5m_0rU-6Q-8WlsnrsWYl48VgKic-mfhMdYqCt36w2NiCcvcqj2iEyNArEhW44NX8tHCa9d4lAEIxqT4rFIhIg0rDS-7XZ8s3OYRFrThafneg9GLlXUL_xGc Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:19.050027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b629d01691534ffa8bb750edfd4df96d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 787de57b64a84860bcad23ad72800b0e Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1278061222", "metadata": {"Type": "work"}}} Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: Aug 07 19:32:19.051455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1278061222', 'metadata': {'Type': 'work'}}}} Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise error Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi '' Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:19.052277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 19:32:19.053546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 19:32:19.054755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 19:32:19.054755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.054755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e9c5ed5-e4fd-4423-ad9e-7e552769d920 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:19.054755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6e9c5ed5-e4fd-4423-ad9e-7e552769d920 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011433 Aug 07 19:32:19.054755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 373/760] 10.222.0.17 () {60 vars in 1156 bytes} [Sun Aug 7 19:32:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:32:19.062313 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f71e4d8b-4074-4d9b-bcf3-11038a31b64f tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Calling method '.version_select at 0x7fd476b4ac10>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:19.093257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-f71e4d8b-4074-4d9b-bcf3-11038a31b64f tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] HTTP exception thrown: Volume tempest-invalid-882062728 could not be found. Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f71e4d8b-4074-4d9b-bcf3-11038a31b64f tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Request method failure captured: Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-882062728 HTTP/1.1 Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BNCHmnnTI5GHDpPxH0N-5zy4-whhi3gxQtLXkTDvLkXuixgwvgfHAOs5m_0rU-6Q-8WlsnrsWYl48VgKic-mfhMdYqCt36w2NiCcvcqj2iEyNArEhW44NX8tHCa9d4lAEIxqT4rFIhIg0rDS-7XZ8s3OYRFrThafneg9GLlXUL_xGc Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:32:19.095320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b629d01691534ffa8bb750edfd4df96d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 787de57b64a84860bcad23ad72800b0e Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Volume tempest-invalid-882062728 could not be found. Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'tempest-invalid-882062728'} Aug 07 19:32:19.097734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-882062728 could not be found. (HTTP 404) (Request-ID: req-dbd1df74-5d4f-4bb8-9aa7-8a30b10953f2) Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.098829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 19:32:19.100189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-882062728 could not be found. Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:19.101357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-882062728 could not be found. Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-882062728 could not be found. Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f71e4d8b-4074-4d9b-bcf3-11038a31b64f tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Returning 404 to user: Volume tempest-invalid-882062728 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f71e4d8b-4074-4d9b-bcf3-11038a31b64f tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-882062728" status: 404 len: 98 microversion: 2.1 time: 0.038899 Aug 07 19:32:19.102529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 388/761] 10.222.0.17 () {58 vars in 1215 bytes} [Sun Aug 7 19:32:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-882062728 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 19:32:19.106905 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-015a06c7-8efc-442b-8e87-cf2550323fc2 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003684 Aug 07 19:32:19.107397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 374/762] 10.222.0.17 () {58 vars in 1140 bytes} [Sun Aug 7 19:32:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 07 19:32:19.115931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dc92e3f0-482d-4e27-aa38-ee97ca7be4d2 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003878 Aug 07 19:32:19.116452 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 389/763] 10.222.0.17 () {58 vars in 1137 bytes} [Sun Aug 7 19:32:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 19:32:19.125786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0b7076aa-ed59-4b8c-a462-737aae936c1e tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Calling method '.version_select at 0x7fd476b57ca0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:19.156799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-0b7076aa-ed59-4b8c-a462-737aae936c1e tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] HTTP exception thrown: Volume d809d6f5-09bc-4730-aa80-b4dbc5807175 could not be found. Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0b7076aa-ed59-4b8c-a462-737aae936c1e tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Request method failure captured: Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/os-volumes/d809d6f5-09bc-4730-aa80-b4dbc5807175 HTTP/1.1 Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BNCHmnnTI5GHDpPxH0N-5zy4-whhi3gxQtLXkTDvLkXuixgwvgfHAOs5m_0rU-6Q-8WlsnrsWYl48VgKic-mfhMdYqCt36w2NiCcvcqj2iEyNArEhW44NX8tHCa9d4lAEIxqT4rFIhIg0rDS-7XZ8s3OYRFrThafneg9GLlXUL_xGc Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:19.158972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b629d01691534ffa8bb750edfd4df96d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 787de57b64a84860bcad23ad72800b0e Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Volume d809d6f5-09bc-4730-aa80-b4dbc5807175 could not be found. Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd809d6f5-09bc-4730-aa80-b4dbc5807175'} Aug 07 19:32:19.160596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d809d6f5-09bc-4730-aa80-b4dbc5807175 could not be found. (HTTP 404) (Request-ID: req-0913422b-394a-4efe-8737-1d62171d1546) Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.164857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 19:32:19.166357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d809d6f5-09bc-4730-aa80-b4dbc5807175 could not be found. Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 19:32:19.167671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d809d6f5-09bc-4730-aa80-b4dbc5807175 could not be found. Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d809d6f5-09bc-4730-aa80-b4dbc5807175 could not be found. Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0b7076aa-ed59-4b8c-a462-737aae936c1e tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Returning 404 to user: Volume d809d6f5-09bc-4730-aa80-b4dbc5807175 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0b7076aa-ed59-4b8c-a462-737aae936c1e tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/d809d6f5-09bc-4730-aa80-b4dbc5807175" status: 404 len: 109 microversion: 2.1 time: 0.038895 Aug 07 19:32:19.169022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 375/764] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:32:19 2022] DELETE /compute/v2.1/os-volumes/d809d6f5-09bc-4730-aa80-b4dbc5807175 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 19:32:19.172163 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eef29a9e-c432-4867-bfbe-746cb8187e70 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Calling method '.version_select at 0x7fd476bf1310>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:19.199292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-eef29a9e-c432-4867-bfbe-746cb8187e70 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] HTTP exception thrown: Volume fd444ead-8c4e-4aa9-9ad0-b0146e363474 could not be found. Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eef29a9e-c432-4867-bfbe-746cb8187e70 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Request method failure captured: Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/os-volumes/fd444ead-8c4e-4aa9-9ad0-b0146e363474 HTTP/1.1 Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BNCHmnnTI5GHDpPxH0N-5zy4-whhi3gxQtLXkTDvLkXuixgwvgfHAOs5m_0rU-6Q-8WlsnrsWYl48VgKic-mfhMdYqCt36w2NiCcvcqj2iEyNArEhW44NX8tHCa9d4lAEIxqT4rFIhIg0rDS-7XZ8s3OYRFrThafneg9GLlXUL_xGc Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:32:19.201310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b629d01691534ffa8bb750edfd4df96d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b629d01691534ffa8bb750edfd4df96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: b629d01691534ffa8bb750edfd4df96d Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-1706216209 Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 787de57b64a84860bcad23ad72800b0e Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-1706216209-project Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Volume fd444ead-8c4e-4aa9-9ad0-b0146e363474 could not be found. Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'fd444ead-8c4e-4aa9-9ad0-b0146e363474'} Aug 07 19:32:19.202867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd444ead-8c4e-4aa9-9ad0-b0146e363474 could not be found. (HTTP 404) (Request-ID: req-043199fe-246f-4a96-9a2a-d2bba38bc09a) Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.203674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 19:32:19.204940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd444ead-8c4e-4aa9-9ad0-b0146e363474 could not be found. Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 19:32:19.206272 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd444ead-8c4e-4aa9-9ad0-b0146e363474 could not be found. Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd444ead-8c4e-4aa9-9ad0-b0146e363474 could not be found. Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eef29a9e-c432-4867-bfbe-746cb8187e70 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] Returning 404 to user: Volume fd444ead-8c4e-4aa9-9ad0-b0146e363474 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eef29a9e-c432-4867-bfbe-746cb8187e70 tempest-VolumesNegativeTest-1706216209 tempest-VolumesNegativeTest-1706216209-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fd444ead-8c4e-4aa9-9ad0-b0146e363474" status: 404 len: 109 microversion: 2.1 time: 0.036095 Aug 07 19:32:19.207665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 390/765] 10.222.0.17 () {58 vars in 1245 bytes} [Sun Aug 7 19:32:19 2022] GET /compute/v2.1/os-volumes/fd444ead-8c4e-4aa9-9ad0-b0146e363474 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:23.495463 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-459907569", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "networks": [{"uuid": "ad6cf24f-b62b-4986-81e8-d0792354d6ee"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:23.551944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] validate_networks() for [('ad6cf24f-b62b-4986-81e8-d0792354d6ee', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:32:23.918260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:32:23.919047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:32:23.919548 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:32:23.920364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:32:23.920814 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:32:23.930137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:23.930726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:23.931223 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:23.932042 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:23.932790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:23.933293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:23.940621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:23.964952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Getting quotas for project 34950b5c9a734f5cb5820e83dedd4030. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:32:23.969898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Getting quotas for user de73f338e6ef4844979ead86ef2bd16c and project 34950b5c9a734f5cb5820e83dedd4030. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:32:23.985210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:32:23.987530 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:32:24.037066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6eef207e-e373-4725-86f8-040619df496b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546855 Aug 07 19:32:24.037847 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 376/766] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:32:24.046911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:24.048279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:24.053410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-89788ed8-0f12-4355-a51a-a2d16bac95b5 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:24.054004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-89788ed8-0f12-4355-a51a-a2d16bac95b5 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:24.112198 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-89788ed8-0f12-4355-a51a-a2d16bac95b5 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:24.120762 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-89788ed8-0f12-4355-a51a-a2d16bac95b5 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1213 microversion: 2.1 time: 0.075855 Aug 07 19:32:24.121437 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 391/767] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:24 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:25.143352 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:25.143955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:25.150996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:25.151519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:25.151954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:25.152676 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:25.153129 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:25.153550 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:25.242291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:25.250475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9a9aa54a-dfd1-466b-99f0-951bdf7aaeed tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1273 microversion: 2.1 time: 0.111177 Aug 07 19:32:25.261061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 377/768] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:25 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:26.273131 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:26.273889 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:26.280912 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:26.281388 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:26.281816 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:26.282512 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:26.282957 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:26.283340 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:26.420499 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:26.428024 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cdaf5eb8-c3da-42d5-943c-f0a1eded6fb0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1313 microversion: 2.1 time: 0.158792 Aug 07 19:32:26.428597 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 392/769] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:26 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:26.535620 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f308accc-287b-48ea-ac6a-d823e6ffd4c3 req-88295964-afde-410c-a5fe-763c0a3397d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00331651-0ff7-488c-9470-1ab999ae9a56", "tag": "41d03e22-5908-47d1-9c48-dba742a00fea"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:26.547068 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f308accc-287b-48ea-ac6a-d823e6ffd4c3 req-88295964-afde-410c-a5fe-763c0a3397d6 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:26.547554 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f308accc-287b-48ea-ac6a-d823e6ffd4c3 req-88295964-afde-410c-a5fe-763c0a3397d6 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:26.548031 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f308accc-287b-48ea-ac6a-d823e6ffd4c3 req-88295964-afde-410c-a5fe-763c0a3397d6 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:26.560923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f308accc-287b-48ea-ac6a-d823e6ffd4c3 req-88295964-afde-410c-a5fe-763c0a3397d6 service nova] Creating event network-changed:41d03e22-5908-47d1-9c48-dba742a00fea for instance 00331651-0ff7-488c-9470-1ab999ae9a56 on hv-cinder-85032 Aug 07 19:32:26.565896 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f308accc-287b-48ea-ac6a-d823e6ffd4c3 req-88295964-afde-410c-a5fe-763c0a3397d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034008 Aug 07 19:32:26.566588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 378/770] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:27.449725 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:27.450428 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:27.457880 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:27.458393 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:27.459050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:27.459813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:27.460333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:27.460762 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:27.596326 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:27.603787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e25ba8b8-a37b-4fdf-b055-e9dbb8504add tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1313 microversion: 2.1 time: 0.158208 Aug 07 19:32:27.604376 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 393/771] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:27 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:28.272163 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:28.273168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:28.282920 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:28.284190 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:28.284892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:28.286095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:28.286869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:28.287604 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:28.331970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-57e9336d-34d7-4080-bbb8-1de0020b0bcb tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/ips" status: 200 len: 152 microversion: 2.20 time: 0.068184 Aug 07 19:32:28.332610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 379/772] 10.222.0.17 () {60 vars in 1289 bytes} [Sun Aug 7 19:32:28 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/ips => generated 152 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:32:28.484617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:28.487162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:28.494248 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:28.494923 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:28.495456 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:28.496832 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:28.497287 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:28.497706 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:28.523848 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-05a82b93-3f25-4adf-b707-0f4d8165212d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/ips" status: 200 len: 148 microversion: 2.1 time: 0.044081 Aug 07 19:32:28.524459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 394/773] 10.222.0.17 () {58 vars in 1248 bytes} [Sun Aug 7 19:32:28 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:28.626999 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:28.627640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:28.642999 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:28.643834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:28.645307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:28.646076 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:28.647379 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:28.647815 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:28.805745 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:28.816777 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2f43ed89-e854-4a7b-ac55-f51bcce9331a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1313 microversion: 2.1 time: 0.195349 Aug 07 19:32:28.824221 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 380/774] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:28 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:29.838184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:29.838817 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:29.845394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:29.845877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:29.846544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:29.846989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:29.847701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:29.856831 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:29.914110 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a74f7b0-9744-42b8-802c-76b7d5e3d054"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:29.916643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:29.923550 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:29.924171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:29.924729 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:29.925608 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:29.926139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:29.926670 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:30.021165 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:30.033166 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-afc17fdc-985a-422d-8752-6abe356910b3 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1313 microversion: 2.1 time: 0.198771 Aug 07 19:32:30.033839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 395/775] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:29 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:30.203450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:30.204108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:30.210262 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:30.210976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:30.211443 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:30.212182 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:30.212612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:30.213205 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:30.251970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lazy-loading 'flavor' on Instance uuid 0bd99150-d69e-492b-935e-7ca2d4e55b0b {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:32:30.258483 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-72389c01-3907-4ee9-9a59-1b5926879ced tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "POST /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348348 Aug 07 19:32:30.259257 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 381/776] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:32:29 2022] POST /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:32:30.466800 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a9dc8e2d-eed8-41da-883e-8fb533e4b6ce tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/action" status: 202 len: 0 microversion: 2.20 time: 0.266826 Aug 07 19:32:30.468839 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 396/777] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Aug 7 19:32:30 2022] POST /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 19:32:30.480662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:30.481355 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:30.490483 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:30.494375 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:30.494820 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:30.495540 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:30.496015 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:30.496438 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:30.636757 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:30.647089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:30.649021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:30.650378 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aec2b3b8-557d-464a-b0b5-e539b1268dd0 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.174674 Aug 07 19:32:30.651129 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 382/778] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:30 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:31.056328 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:31.057016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:31.063881 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:31.064559 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:31.064984 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:31.065693 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:31.066146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:31.066568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:31.205661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:31.213439 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1b138cb1-fb75-465e-9c1e-8881a7f05b7f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1313 microversion: 2.1 time: 0.161914 Aug 07 19:32:31.214036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 397/779] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:31 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:31.674455 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:31.675069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:31.681226 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:31.681708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:31.682145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:31.682841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:31.683291 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:31.683712 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:31.818827 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:31.826817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:31.828334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:31.829533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ab90c17-e31a-48f7-9175-404a2e2adcc9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.159403 Aug 07 19:32:31.830054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 383/780] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:31 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:32.234872 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:32.235660 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:32.252426 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:32.252911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:32.253344 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:32.254110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:32.254541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:32.254960 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:32.414816 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:32.423117 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ac278711-7cd7-47b2-a5f0-7a9d430fbaa8 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1313 microversion: 2.1 time: 0.192157 Aug 07 19:32:32.436889 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 398/781] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:32 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:32.853355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:32.854473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:32.861525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:32.862588 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:32.863090 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:32.863906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:32.864427 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:32.864987 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:32.947732 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-9d5d8433-c31c-4da0-9235-5660de446d7f req-ab39ce84-f231-4308-985a-2d7c4e2b8f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00331651-0ff7-488c-9470-1ab999ae9a56", "name": "network-vif-plugged", "status": "completed", "tag": "41d03e22-5908-47d1-9c48-dba742a00fea"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:32.957637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9d5d8433-c31c-4da0-9235-5660de446d7f req-ab39ce84-f231-4308-985a-2d7c4e2b8f0d service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:32.958089 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9d5d8433-c31c-4da0-9235-5660de446d7f req-ab39ce84-f231-4308-985a-2d7c4e2b8f0d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:32.958529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9d5d8433-c31c-4da0-9235-5660de446d7f req-ab39ce84-f231-4308-985a-2d7c4e2b8f0d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:32.970664 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-9d5d8433-c31c-4da0-9235-5660de446d7f req-ab39ce84-f231-4308-985a-2d7c4e2b8f0d service nova] Creating event network-vif-plugged:41d03e22-5908-47d1-9c48-dba742a00fea for instance 00331651-0ff7-488c-9470-1ab999ae9a56 on hv-cinder-85032 Aug 07 19:32:32.975774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-9d5d8433-c31c-4da0-9235-5660de446d7f req-ab39ce84-f231-4308-985a-2d7c4e2b8f0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162874 Aug 07 19:32:32.976494 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 384/782] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:33.004390 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:33.012648 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:33.014043 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:33.015188 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-09255976-9c2d-42fe-b465-3a7a50cd279b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.165972 Aug 07 19:32:33.015734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 399/783] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:32 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:32:33.445676 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:33.446366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:33.452884 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:33.453307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:33.453737 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:33.454474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:33.454915 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:33.455487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:33.606060 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:33.615400 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-df25c5ea-276c-46f5-b90d-ea28928f462d tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1313 microversion: 2.1 time: 0.174024 Aug 07 19:32:33.616255 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 385/784] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:33 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:34.038366 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:34.038967 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:34.046314 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:34.046782 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:34.047189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:34.047867 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:34.048342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:34.048746 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:34.120359 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:34.190908 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:34.202699 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:34.205012 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:34.206593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a18c7c50-2c75-45e2-a73d-188d2e98cb76 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.172113 Aug 07 19:32:34.207273 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 400/785] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:34 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:34.637373 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:34.637973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:34.640491 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:34.641148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:34.647476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:34.647969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:34.648426 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:34.649123 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:34.649572 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:34.649993 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:34.788990 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:34.798066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-656b8741-2479-4b1b-9d70-fc4a7d2ffa51 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1497 microversion: 2.1 time: 0.164941 Aug 07 19:32:34.798638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 386/786] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:34 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:35.229768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:35.231000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:35.237787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:35.238269 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:35.238723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:35.239468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:35.239875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:35.240380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:35.317297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:35.317801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:35.319734 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:35.325268 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:35.325779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:35.326216 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:35.326924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:35.327384 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:35.327869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:35.354942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:32:35.386205 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:35.394649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:35.396166 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:35.397322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-63d448ad-0c72-4215-bbe7-d9e90c18d10b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.171603 Aug 07 19:32:35.397888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 401/787] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:35 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:35.436262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f0be047f-9e59-4836-9a17-67705e8abd33 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "DELETE /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 204 len: 0 microversion: 2.1 time: 0.122592 Aug 07 19:32:35.436959 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 387/788] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:35 2022] DELETE /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:32:35.445745 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:35.446394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:35.452332 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:35.452813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:35.453244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:35.453925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:35.454372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:35.454788 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:35.592724 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:35.600675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0ca32fdc-6ad4-47cc-9fd7-be2defcc7ad0 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1503 microversion: 2.1 time: 0.158755 Aug 07 19:32:35.601263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 402/789] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:35 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:36.422134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:36.422987 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:36.429860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:36.430342 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:36.430779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:36.431476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:36.431934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:36.432414 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:36.571525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:36.580225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:36.581837 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:36.582992 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-25014511-de01-47b1-9404-8ab046e1fec9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.165637 Aug 07 19:32:36.583564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 388/790] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:36 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:36.626277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:36.626918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:36.634195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:36.634670 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:36.635095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:36.635784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:36.636456 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:36.637428 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:36.803446 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:36.812438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0ce081a3-a03c-43b0-9f37-50d4247b703f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1503 microversion: 2.1 time: 0.190216 Aug 07 19:32:36.813089 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 403/791] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:36 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:37.607335 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:37.608068 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:37.615484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:37.616283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:37.617549 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:37.618724 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:37.619463 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:37.620122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:37.777064 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:37.785775 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:37.787734 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:37.789479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7d2a1dc4-1cff-4bfe-9d40-2acb5017bcd4 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.186644 Aug 07 19:32:37.790241 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 389/792] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:37 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:37.834922 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:37.836590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:37.845123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:37.845847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:37.846542 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:37.847692 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:37.848419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:37.849163 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:37.957122 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:37.968184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f7bf0a1-a0fe-4393-bf11-6cc4cdc77da7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 200 len: 1461 microversion: 2.1 time: 0.137329 Aug 07 19:32:37.969106 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 404/793] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:37 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 1461 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:38.012231 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-72019496-0b23-421d-8420-a97b6d27ac63 req-44776d36-f46e-47b2-baa2-782f8f2b5157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00331651-0ff7-488c-9470-1ab999ae9a56", "name": "network-vif-deleted", "tag": "41d03e22-5908-47d1-9c48-dba742a00fea"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:38.015215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:38.016183 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:38.022738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:38.023369 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:38.023923 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:38.024844 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:38.025318 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:38.025837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:38.032561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-72019496-0b23-421d-8420-a97b6d27ac63 req-44776d36-f46e-47b2-baa2-782f8f2b5157 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:38.034049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-72019496-0b23-421d-8420-a97b6d27ac63 req-44776d36-f46e-47b2-baa2-782f8f2b5157 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:38.035010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-72019496-0b23-421d-8420-a97b6d27ac63 req-44776d36-f46e-47b2-baa2-782f8f2b5157 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:38.048746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-72019496-0b23-421d-8420-a97b6d27ac63 req-44776d36-f46e-47b2-baa2-782f8f2b5157 service nova] Creating event network-vif-deleted:41d03e22-5908-47d1-9c48-dba742a00fea for instance 00331651-0ff7-488c-9470-1ab999ae9a56 on hv-cinder-85032 Aug 07 19:32:38.055374 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-72019496-0b23-421d-8420-a97b6d27ac63 req-44776d36-f46e-47b2-baa2-782f8f2b5157 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051780 Aug 07 19:32:38.056663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 390/794] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:38.121109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lazy-loading 'services' on Instance uuid ef7650b6-ba15-4820-a6d4-433b96dda30b {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:32:38.198213 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b2d552fe-b4b0-40d7-97c3-8227846399c8 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments/6a74f7b0-9744-42b8-802c-76b7d5e3d054" status: 202 len: 0 microversion: 2.1 time: 0.186761 Aug 07 19:32:38.198816 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 405/795] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:32:38 2022] DELETE /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments/6a74f7b0-9744-42b8-802c-76b7d5e3d054 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:32:38.207932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:38.210263 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:38.217016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:38.217512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:38.217947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:38.218659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:38.219187 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:38.219634 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:38.250360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-194ad1e3-ee40-417c-b4d6-6e5640e41dc3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046749 Aug 07 19:32:38.250924 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 391/796] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:32:38 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:32:38.816603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:38.817294 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:38.823778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:38.824288 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:38.824713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:38.825396 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:38.825847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:38.826260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:38.830338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:38.962107 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:38.970815 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:38.972382 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:38.973659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ef5d30a0-ea12-4b20-b426-e550d571a5ad tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.161964 Aug 07 19:32:38.974350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 406/797] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:38 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:38.995131 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:38.995751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 00331651-0ff7-488c-9470-1ab999ae9a56] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:39.002894 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.003516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.003847 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.004545 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.005039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.005625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.025680 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] HTTP exception thrown: Instance 00331651-0ff7-488c-9470-1ab999ae9a56 could not be found. Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Request method failure captured: Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 HTTP/1.1 Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BNFo4VLRc_5vFEHaP_rc7809ltg44_pEA1fpXuBgCaPXm4X2Zx-FEnh11jTxghPUCB1QUybRrdEt6SF9llshmvNrMMIpMjwT1_NVG0qCoFAsFT6Vltc7yO5iJKNCSLzjkuDGJjTi6xonlDgKMSe7flyvk1zujG7SYLy0oybwwKnflA Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: 34950b5c9a734f5cb5820e83dedd4030 Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesActionsTest-456713871 Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:39.027403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34950b5c9a734f5cb5820e83dedd4030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34950b5c9a734f5cb5820e83dedd4030", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34950b5c9a734f5cb5820e83dedd4030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34950b5c9a734f5cb5820e83dedd4030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesActionsTest-456713871 Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 34950b5c9a734f5cb5820e83dedd4030 Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesActionsTest-456713871 Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesActionsTest-456713871-project Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: de73f338e6ef4844979ead86ef2bd16c Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesActionsTest-456713871-project Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 00331651-0ff7-488c-9470-1ab999ae9a56 could not be found. Aug 07 19:32:39.029072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '00331651-0ff7-488c-9470-1ab999ae9a56'} Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00331651-0ff7-488c-9470-1ab999ae9a56 could not be found. Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:39.029835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00331651-0ff7-488c-9470-1ab999ae9a56 could not be found. Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00331651-0ff7-488c-9470-1ab999ae9a56 could not be found. Aug 07 19:32:39.031215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:39.032367 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Returning 404 to user: Instance 00331651-0ff7-488c-9470-1ab999ae9a56 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:39.032367 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9bc5a93-21b9-4de4-b056-26d2034d3861 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56" status: 404 len: 111 microversion: 2.1 time: 0.041000 Aug 07 19:32:39.032367 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 392/798] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:38 2022] GET /compute/v2.1/servers/00331651-0ff7-488c-9470-1ab999ae9a56 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:39.131271 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-985808823", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "networks": [{"uuid": "ad6cf24f-b62b-4986-81e8-d0792354d6ee"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:39.188812 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] validate_networks() for [('ad6cf24f-b62b-4986-81e8-d0792354d6ee', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:32:39.263453 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:39.265961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:39.272331 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.273121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.273762 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.274707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.275386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.275876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.292796 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:39.315073 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-01a61830-0945-45d3-92dd-d547529ddac5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055720 Aug 07 19:32:39.315671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 393/799] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:32:39 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 19:32:39.377964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:39.378469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:39.384651 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.385205 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.385725 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.386395 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.386841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.387264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.413874 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:32:39.495928 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-02c18f94-874b-49cd-99f0-cf5edbcd9523 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 204 len: 0 microversion: 2.1 time: 0.121845 Aug 07 19:32:39.497057 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 394/800] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:39 2022] DELETE /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 19:32:39.506905 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:39.508020 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:39.514738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.515398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.515958 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.516876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.517432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.517911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.578614 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:32:39.579058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:32:39.579550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:32:39.579957 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:32:39.580424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:32:39.589227 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.589724 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.590136 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.590851 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:39.591303 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:39.591697 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:39.608972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Getting quotas for project 34950b5c9a734f5cb5820e83dedd4030. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:32:39.612972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Getting quotas for user de73f338e6ef4844979ead86ef2bd16c and project 34950b5c9a734f5cb5820e83dedd4030. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:32:39.623906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:32:39.626211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:32:39.664046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:39.672040 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2df30f9d-691a-40c7-ad7d-a4457d3f7dd6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1680 microversion: 2.1 time: 0.169938 Aug 07 19:32:39.672775 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 395/801] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:39 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:39.673259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8bfaf448-30a7-498c-824f-b4c1a14f2f68 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547055 Aug 07 19:32:39.674013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 407/802] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:32:39.684809 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4023f8e4-a035-43a1-adbc-9bd8a7b6dee2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:39.685579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4023f8e4-a035-43a1-adbc-9bd8a7b6dee2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:39.744246 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4023f8e4-a035-43a1-adbc-9bd8a7b6dee2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:39.764986 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4023f8e4-a035-43a1-adbc-9bd8a7b6dee2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1213 microversion: 2.1 time: 0.083919 Aug 07 19:32:39.765578 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 396/803] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:39 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:39.997850 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:39.998570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:40.005991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:40.006563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:40.007687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:40.008412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:40.008866 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:40.009287 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:40.147775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:40.156358 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:40.157859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:40.159023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8a70378a-ad72-464a-a61e-3a25550a0874 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.165142 Aug 07 19:32:40.159585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 408/804] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:39 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:40.695177 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:40.695806 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:40.703072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:40.703557 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:40.704019 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:40.704735 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:40.705196 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:40.705624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:40.785691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:40.786297 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:40.792618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:40.793084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:40.793520 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:40.794195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:40.794752 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:40.795556 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:40.867668 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:40.871086 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:40.875432 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8048ea66-d4f4-4a37-8690-5c680ebb30ef tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1217 microversion: 2.1 time: 0.093686 Aug 07 19:32:40.876093 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 409/805] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:40 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:32:40.879213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b00195eb-fbe9-4f8e-928c-78873f6509b6 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1680 microversion: 2.1 time: 0.187915 Aug 07 19:32:40.879793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 397/806] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:40 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:41.182850 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:41.183465 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:41.190476 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:41.191015 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:41.191595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:41.192349 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:41.192846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:41.193279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:41.338301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:41.346891 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:41.348464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:41.349613 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-66c312a4-2081-4764-bd3e-b9e3d1f572c6 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.170780 Aug 07 19:32:41.350187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 410/807] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:41 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:41.901029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:41.903347 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:41.903712 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:41.907372 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:41.915093 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:41.918342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:41.920958 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:41.921775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:41.922733 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:41.923376 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:41.924222 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:41.924858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:41.925558 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:41.931536 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:41.932269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:41.932892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:42.051432 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:42.060932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0991b833-6f97-4dea-815b-a34150e040ad tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1613 microversion: 2.1 time: 0.163669 Aug 07 19:32:42.061652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 411/808] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:41 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1613 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:32:42.075405 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:42.083318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b2cd220f-28d3-4c20-9f5d-2e58dc255c38 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1271 microversion: 2.1 time: 0.190553 Aug 07 19:32:42.083897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 398/809] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:41 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:42.372948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:42.374217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:42.381495 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:42.382380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:42.383000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:42.383860 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:42.384484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:42.385059 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:42.566330 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-9c33d614-0d2c-4fdd-a288-196f5851073d req-5a2a2316-9fdf-44a6-92ad-20fcd857c28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7650b6-ba15-4820-a6d4-433b96dda30b", "name": "network-vif-deleted", "tag": "e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:42.590312 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:42.591582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9c33d614-0d2c-4fdd-a288-196f5851073d req-5a2a2316-9fdf-44a6-92ad-20fcd857c28f service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:42.593996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9c33d614-0d2c-4fdd-a288-196f5851073d req-5a2a2316-9fdf-44a6-92ad-20fcd857c28f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:42.594579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9c33d614-0d2c-4fdd-a288-196f5851073d req-5a2a2316-9fdf-44a6-92ad-20fcd857c28f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:42.605843 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:42.607412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:42.608819 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-91bcf88a-f726-4a68-8632-5cef67ef6907 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.239992 Aug 07 19:32:42.609432 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 412/810] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:42 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:42.621440 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-9c33d614-0d2c-4fdd-a288-196f5851073d req-5a2a2316-9fdf-44a6-92ad-20fcd857c28f service nova] Creating event network-vif-deleted:e8b34ce0-ab1a-4ee5-88c4-61f6b2c0b92e for instance ef7650b6-ba15-4820-a6d4-433b96dda30b on hv-cinder-85032 Aug 07 19:32:42.627199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-9c33d614-0d2c-4fdd-a288-196f5851073d req-5a2a2316-9fdf-44a6-92ad-20fcd857c28f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065872 Aug 07 19:32:42.628662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 399/811] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:32:43.086947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:43.087843 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:43.097219 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:43.099599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:43.101217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:43.102986 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:43.103633 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:43.104527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:43.108203 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:43.108203 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:43.118734 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:43.119264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:43.119734 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:43.120550 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:43.121033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:43.121503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:43.176487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:43.177472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:43.180472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:43.181180 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lazy-loading 'fault' on Instance uuid ef7650b6-ba15-4820-a6d4-433b96dda30b {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:32:43.277898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3e2afc428a45e2b993c39e3d53cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10e8224d7aa4b019ccad26aa3398933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:43.286031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c185e410-d55b-4ac9-a6c8-56a87ccecea3 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 200 len: 1332 microversion: 2.1 time: 0.203925 Aug 07 19:32:43.287208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 413/812] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:43 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:43.426037 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:43.439570 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4f8e516c-4cc2-4c4e-af14-669bf107b6fa tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1313 microversion: 2.1 time: 0.336535 Aug 07 19:32:43.443027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 400/813] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:43 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:43.635600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:43.636691 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:43.646439 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:43.647185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:43.647932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:43.649323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:43.649813 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:43.650245 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:43.840044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:43.851915 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:43.854595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:43.856412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-098f445a-fe4d-4b6d-b18f-f4f6677fed84 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.226729 Aug 07 19:32:43.869000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 414/814] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:43 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:44.308802 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:44.309466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:44.316889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:44.317380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:44.318001 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:44.318720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:44.319171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:44.319596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:44.463672 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:44.464519 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:44.472167 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:44.473000 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:44.473767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:44.474723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:44.475185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:44.475611 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:44.495179 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b HTTP/1.1 Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:44.496860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:44.498427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ef7650b6-ba15-4820-a6d4-433b96dda30b'} Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:44.499293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:44.500793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:44.502082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:44.502082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-197f0c38-5886-467a-93fc-37424c47e60a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 404 len: 111 microversion: 2.1 time: 0.193603 Aug 07 19:32:44.502082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 401/815] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:44 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:44.508053 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4c11c000-a3f7-4129-812f-074949d49b4a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '.version_select at 0x7fd476b44280>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:44.532559 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4c11c000-a3f7-4129-812f-074949d49b4a tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375057704" status: 202 len: 0 microversion: 2.1 time: 0.028959 Aug 07 19:32:44.536044 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 402/816] 10.222.0.17 () {58 vars in 1221 bytes} [Sun Aug 7 19:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375057704 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 19:32:44.632782 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:44.641342 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bdfac5d0-1c13-4aa3-a3ad-1dbe6463999b tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1313 microversion: 2.1 time: 0.182189 Aug 07 19:32:44.654617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 415/817] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:44 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:32:44.654818 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-bd3abd72-77a0-4ac8-8194-f54ba967f1e6 req-e2e304ee-b87d-49c1-a593-18bdb716503a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f", "tag": "55661136-3e46-433d-937c-8baa6cf989c5"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:44.664062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bd3abd72-77a0-4ac8-8194-f54ba967f1e6 req-e2e304ee-b87d-49c1-a593-18bdb716503a service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:44.664661 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bd3abd72-77a0-4ac8-8194-f54ba967f1e6 req-e2e304ee-b87d-49c1-a593-18bdb716503a service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:44.665083 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bd3abd72-77a0-4ac8-8194-f54ba967f1e6 req-e2e304ee-b87d-49c1-a593-18bdb716503a service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:44.684333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-bd3abd72-77a0-4ac8-8194-f54ba967f1e6 req-e2e304ee-b87d-49c1-a593-18bdb716503a service nova] Creating event network-changed:55661136-3e46-433d-937c-8baa6cf989c5 for instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f on hv-cinder-85032 Aug 07 19:32:44.689941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-bd3abd72-77a0-4ac8-8194-f54ba967f1e6 req-e2e304ee-b87d-49c1-a593-18bdb716503a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041415 Aug 07 19:32:44.696648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 403/818] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:44.885899 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:44.886700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:44.894242 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:44.895067 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:44.895763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:44.896797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:44.897462 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:44.898090 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:45.263521 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:45.280341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:45.283367 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:45.285918 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-992487ea-6b06-43a9-9c79-67f97751a1e9 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.404050 Aug 07 19:32:45.286481 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 416/819] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:44 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:45.665786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:45.666821 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:45.674488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:45.674996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:45.675529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:45.676365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:45.676925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:45.677537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:45.836832 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:45.846474 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-591e75d8-2585-4706-a965-bb13dc2c94e7 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1313 microversion: 2.1 time: 0.186227 Aug 07 19:32:45.847099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 404/820] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:45 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:46.310680 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:46.311513 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:46.318603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.319085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.319539 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:46.320259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.320705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.321148 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:46.456397 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:46.475330 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:46.477434 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:46.479093 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b9e89ff0-7453-4a8f-b08f-93e79bb257e3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1744 microversion: 2.20 time: 0.172360 Aug 07 19:32:46.483781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 417/821] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:46 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:46.724936 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:46.725469 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:46.732290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.732778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.733204 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:46.733876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.734319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.734729 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:46.748885 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b HTTP/1.1 Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:46.750607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.753225 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ef7650b6-ba15-4820-a6d4-433b96dda30b'} Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:46.754588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.757211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.759470 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:46.759470 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a93b960a-347b-4eab-891f-40d824cf0f6e tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 07 19:32:46.759470 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 405/822] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:46 2022] DELETE /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:46.761160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:46.761784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ef7650b6-ba15-4820-a6d4-433b96dda30b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:46.768600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.769011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.769561 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:46.770306 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.770771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.771194 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:46.787814 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b HTTP/1.1 Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:32:46.790095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.791751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'ef7650b6-ba15-4820-a6d4-433b96dda30b'} Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:46.792608 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. Aug 07 19:32:46.793965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:46.797170 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance ef7650b6-ba15-4820-a6d4-433b96dda30b could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:46.798261 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-45fdc0ba-d913-4bba-824e-1c17c77dac38 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b" status: 404 len: 111 microversion: 2.1 time: 0.041108 Aug 07 19:32:46.802416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 418/823] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:46 2022] GET /compute/v2.1/servers/ef7650b6-ba15-4820-a6d4-433b96dda30b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:46.869553 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:46.870249 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:46.876723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.877307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.877801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:46.878624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:46.879122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:46.879616 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:47.037480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:47.049671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7936fefb-6247-45f8-b3d6-1deee6ca7291 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1313 microversion: 2.1 time: 0.184947 Aug 07 19:32:47.050606 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 406/824] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:46 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:32:47.503522 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:47.504407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:47.511472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:47.511858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:47.512351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:47.513073 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:47.513529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:47.514095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:47.661085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:47.669346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:47.671194 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:47.672407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-84c41498-bd52-4942-9e36-95a737fbd18a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1744 microversion: 2.20 time: 0.173266 Aug 07 19:32:47.672943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 419/825] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:47 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:47.979929 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:47.980486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:47.987039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:47.987513 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:47.988099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:47.988672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:47.989134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:47.989582 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.003057 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 HTTP/1.1 Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:48.004783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.006259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0'} Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:48.007114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.008644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.010033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:48.010033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ffe40f4-aea7-48e0-a694-995782f52969 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 404 len: 111 microversion: 2.1 time: 0.030609 Aug 07 19:32:48.010033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 407/826] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:47 2022] DELETE /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:48.015593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:48.016162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:48.022948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.023450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.024072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.024794 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.025367 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.025956 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.040185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 HTTP/1.1 Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:32:48.041751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.043279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': 'b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0'} Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:48.045422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. Aug 07 19:32:48.046847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.048077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:48.048077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7c99777b-d134-4a96-a3da-b5a9c4c7e099 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0" status: 404 len: 111 microversion: 2.1 time: 0.031508 Aug 07 19:32:48.048077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 420/827] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:48 2022] GET /compute/v2.1/servers/b7345bc4-63a0-4ebf-9f4d-cc12b12a73c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:48.052433 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:48.052936 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:48.059384 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.059858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.060326 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.061010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.061456 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.061871 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.073373 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:48.074076 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:48.077361 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc HTTP/1.1 Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:48.078763 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.080148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc'} Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:48.080873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.082095 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.083300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:48.083300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-06b128b5-c71b-42f6-981c-aa27075c0c58 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 404 len: 111 microversion: 2.1 time: 0.031756 Aug 07 19:32:48.083300 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 408/828] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:48 2022] DELETE /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 19:32:48.083907 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.085017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.086219 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.087327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.088906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.088906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.090760 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:48.091442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:48.098113 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.098699 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.099200 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.099983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.100514 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.101080 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.116171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc HTTP/1.1 Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:48.117713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.119139 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc'} Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:48.120071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. Aug 07 19:32:48.121533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:48.122830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:48.122830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9420e904-916d-4a77-b327-8d3e91bfcb09 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc" status: 404 len: 111 microversion: 2.1 time: 0.032434 Aug 07 19:32:48.122830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 409/829] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:48 2022] GET /compute/v2.1/servers/d0fb7d5a-e373-4579-a4f1-5b4d60d3b3fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 19:32:48.273778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:48.284270 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-74c7c6c8-971d-48f8-a4e2-e1a2349722ac tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1313 microversion: 2.1 time: 0.214725 Aug 07 19:32:48.284877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 421/830] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:48 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:48.695482 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:48.696514 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:48.704893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.706860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.707307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.712937 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:48.713420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:48.713860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:48.876765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:48.898723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:48.900881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:48.902741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ae3f5d1d-6e9f-4004-ba10-b0c4af3bc422 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.211307 Aug 07 19:32:48.908993 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 410/831] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:48 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:32:49.150859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7ec67850-0ad3-4700-a641-1320f5e2edc8 req-ee64180e-ae5c-45b2-bbcf-676afacb5985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f", "name": "network-vif-plugged", "status": "completed", "tag": "55661136-3e46-433d-937c-8baa6cf989c5"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:49.175110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7ec67850-0ad3-4700-a641-1320f5e2edc8 req-ee64180e-ae5c-45b2-bbcf-676afacb5985 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.176143 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7ec67850-0ad3-4700-a641-1320f5e2edc8 req-ee64180e-ae5c-45b2-bbcf-676afacb5985 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.176926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7ec67850-0ad3-4700-a641-1320f5e2edc8 req-ee64180e-ae5c-45b2-bbcf-676afacb5985 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.193794 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7ec67850-0ad3-4700-a641-1320f5e2edc8 req-ee64180e-ae5c-45b2-bbcf-676afacb5985 service nova] Creating event network-vif-plugged:55661136-3e46-433d-937c-8baa6cf989c5 for instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f on hv-cinder-85032 Aug 07 19:32:49.202478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7ec67850-0ad3-4700-a641-1320f5e2edc8 req-ee64180e-ae5c-45b2-bbcf-676afacb5985 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059317 Aug 07 19:32:49.204426 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 422/832] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:49.309682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:49.312302 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:49.317658 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:49.318275 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:49.329091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.330031 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.330682 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.331723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.335307 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.336389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.357490 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.362949 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.363527 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.364400 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.364953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.365522 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.395244 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 HTTP/1.1 Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:49.401356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.403292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ab31f7bc-2dfc-4b03-8e02-37f4ac156634'} Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:49.404428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.406236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.407744 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:49.407877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f46deb4b-617c-48fd-bb08-8c903ca58db5 tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 404 len: 111 microversion: 2.1 time: 0.106407 Aug 07 19:32:49.414142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 411/833] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:49 2022] DELETE /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:49.427451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:49.428859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] [instance: ab31f7bc-2dfc-4b03-8e02-37f4ac156634] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:49.436614 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.437449 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.438133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.439108 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.439795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.440454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.457845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] HTTP exception thrown: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Request method failure captured: Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 HTTP/1.1 Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BHPMZBNGZIv_DwEeDSQPS87DHRNMnItFtkbgqcchjZn7fKVC3Y5nDCLhho-eIG_WJSbBX6aIjmMjBG5QCGqPMGzczxN5oZRbkQ00PKElTrL0xo81zU2WzB0iWEkxy9dc0f0kDLfYxwQGawfonvy5u3hVtpTs5LQJFZfeyjyjS9OUJQ Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:49.460659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b10e8224d7aa4b019ccad26aa3398933", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b10e8224d7aa4b019ccad26aa3398933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: b10e8224d7aa4b019ccad26aa3398933 Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2146371585 Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: be3e2afc428a45e2b993c39e3d53cd8b Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-2146371585-project Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.462170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ab31f7bc-2dfc-4b03-8e02-37f4ac156634'} Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:49.463122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. Aug 07 19:32:49.464420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:49.468674 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] Returning 404 to user: Instance ab31f7bc-2dfc-4b03-8e02-37f4ac156634 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:49.471398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b0da01e-7b6e-4736-aec4-8ecdcf2df09d tempest-AttachVolumeNegativeTest-2146371585 tempest-AttachVolumeNegativeTest-2146371585-project] 10.222.0.17 "GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634" status: 404 len: 111 microversion: 2.1 time: 0.054435 Aug 07 19:32:49.472668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 412/834] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:49 2022] GET /compute/v2.1/servers/ab31f7bc-2dfc-4b03-8e02-37f4ac156634 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:49.600084 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:49.620185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:49.641675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:49.677096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bbe8ddaa-3fd6-40c3-9427-08e25ca94bfc tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1313 microversion: 2.1 time: 0.367856 Aug 07 19:32:49.681132 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 423/835] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:49 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:49.938128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:49.939197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:49.946164 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:49.949031 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.949860 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.950546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:49.951535 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:49.955364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:49.956178 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:50.232332 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:50.256686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:50.259470 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:50.265197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e173ea43-8b72-46c8-9388-246f28d87af7 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.331783 Aug 07 19:32:50.268577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 413/836] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:49 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:50.705848 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:50.707470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:50.722668 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:50.723494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:50.724248 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:50.725438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:50.726722 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:50.727566 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:51.027085 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:51.040814 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bb53e85e-da1e-41d9-aaa6-a4c1870ce48f tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1313 microversion: 2.1 time: 0.341160 Aug 07 19:32:51.042746 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 424/837] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:50 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:51.223439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c6ed9f94-63b7-4627-899b-c46c749cbcff req-c98460e4-422c-491e-8b1e-5a794677a86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd99150-d69e-492b-935e-7ca2d4e55b0b", "name": "network-vif-plugged", "status": "completed", "tag": "f795fad8-24c5-4844-b5bd-2fd41159afb2"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:51.238532 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c6ed9f94-63b7-4627-899b-c46c749cbcff req-c98460e4-422c-491e-8b1e-5a794677a86e service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:51.239349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c6ed9f94-63b7-4627-899b-c46c749cbcff req-c98460e4-422c-491e-8b1e-5a794677a86e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:51.240034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c6ed9f94-63b7-4627-899b-c46c749cbcff req-c98460e4-422c-491e-8b1e-5a794677a86e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:51.265785 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c6ed9f94-63b7-4627-899b-c46c749cbcff req-c98460e4-422c-491e-8b1e-5a794677a86e service nova] Creating event network-vif-plugged:f795fad8-24c5-4844-b5bd-2fd41159afb2 for instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b on hv-cinder-85032 Aug 07 19:32:51.277853 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c6ed9f94-63b7-4627-899b-c46c749cbcff req-c98460e4-422c-491e-8b1e-5a794677a86e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058789 Aug 07 19:32:51.278444 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 414/838] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:51.289687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:51.290594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:51.298418 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:51.299245 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:51.299860 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:51.300845 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:51.301467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:51.302068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:51.307358 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:51.522680 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:51.535657 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:51.537438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:51.539350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-170e0db3-9299-4ed3-8a97-494a6c87ee25 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.253462 Aug 07 19:32:51.540661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 425/839] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:51 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:32:52.066493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:52.068348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:52.080663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:52.081463 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:52.082254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:52.083215 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:52.083669 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:52.084093 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:52.241972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:52.266777 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-126b2a10-8270-4eea-898c-586336f8fe9c tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1497 microversion: 2.1 time: 0.206982 Aug 07 19:32:52.270998 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 415/840] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:52 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:52.569508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:52.571338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:52.592432 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:52.593652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:52.595735 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:52.603013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:52.605093 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:52.606015 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:52.958714 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:52.974764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:52.978111 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:52.980612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-66780343-3138-48d0-a790-b33c68daac66 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.416881 Aug 07 19:32:52.988585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 426/841] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:52 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:53.143026 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:53.143887 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:53.157465 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:53.159954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:53.161359 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:53.162889 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:53.163925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:53.166042 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:53.250121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:32:53.292156 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:53.419689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e25305c3-b5e0-4b36-bf95-f28824c73fa2 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 204 len: 0 microversion: 2.1 time: 0.283408 Aug 07 19:32:53.420950 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 416/842] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:32:53 2022] DELETE /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:32:53.431100 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:53.432130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:53.456274 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:53.457562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:53.458687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:53.461028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:53.462349 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:53.463640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:53.699525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:53.708319 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-164d0e31-f28c-42a6-b8fe-a6183a5ccbe4 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1503 microversion: 2.1 time: 0.281590 Aug 07 19:32:53.713343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 427/843] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:53 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:32:54.013125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:54.013125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:54.023862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:54.025873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:54.026386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:54.027271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:54.027741 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:54.028303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:54.276708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:54.286688 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:54.288520 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:54.289928 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d5bad878-3a1f-4cf9-a488-eadfdf123041 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.287284 Aug 07 19:32:54.291214 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 417/844] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:54 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:54.731065 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:54.732744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:54.757653 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:54.761654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:54.764504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:54.765017 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:54.768780 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:54.772897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:54.773351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:54.969807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:54.990565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b20fdc12-acc7-4ef9-900f-ec6dd1145272 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1503 microversion: 2.1 time: 0.263333 Aug 07 19:32:54.996079 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 428/845] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:54 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:55.315044 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:55.318677 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:55.330276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:55.330767 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:55.331199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:55.331952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:55.332420 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:55.336135 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:55.538801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:55.554190 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:55.555970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:55.557511 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b7a72caf-4c2f-429d-ab84-c87a82b4a544 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.246633 Aug 07 19:32:55.558260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 418/846] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:55 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:55.956263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-1da8f275-82fc-4f92-bee3-bfed3a443cef req-968836da-61fa-4c84-9d4f-b792182ac5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f", "name": "network-vif-deleted", "tag": "55661136-3e46-433d-937c-8baa6cf989c5"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:32:55.970416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1da8f275-82fc-4f92-bee3-bfed3a443cef req-968836da-61fa-4c84-9d4f-b792182ac5f1 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:55.979355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1da8f275-82fc-4f92-bee3-bfed3a443cef req-968836da-61fa-4c84-9d4f-b792182ac5f1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:55.984178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1da8f275-82fc-4f92-bee3-bfed3a443cef req-968836da-61fa-4c84-9d4f-b792182ac5f1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:56.002362 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-1da8f275-82fc-4f92-bee3-bfed3a443cef req-968836da-61fa-4c84-9d4f-b792182ac5f1 service nova] Creating event network-vif-deleted:55661136-3e46-433d-937c-8baa6cf989c5 for instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f on hv-cinder-85032 Aug 07 19:32:56.007911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-1da8f275-82fc-4f92-bee3-bfed3a443cef req-968836da-61fa-4c84-9d4f-b792182ac5f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055360 Aug 07 19:32:56.008579 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 429/847] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:32:56.023591 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:56.024268 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:56.031466 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:56.032451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:56.033669 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:56.034604 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:56.036714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:56.037328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:56.147944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de73f338e6ef4844979ead86ef2bd16c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34950b5c9a734f5cb5820e83dedd4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:56.157248 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f0495f79-db5f-47ca-80ba-871bdeefa22a tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 200 len: 1298 microversion: 2.1 time: 0.139345 Aug 07 19:32:56.158144 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 419/848] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:56 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:32:56.581966 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:56.582942 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:56.594778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:56.596993 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:56.598124 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:56.601167 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:56.601812 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:56.602783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:56.795477 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:56.806735 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:56.809541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:56.811853 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-08868e40-1e75-439c-92ce-419b86ba6587 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.234543 Aug 07 19:32:56.829857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 430/849] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:56 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:57.185729 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:57.186492 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] [instance: 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:57.193303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:57.194063 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:57.194683 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:57.195547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:57.196254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:57.196910 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:57.213988 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] HTTP exception thrown: Instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f could not be found. Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Request method failure captured: Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f HTTP/1.1 Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BNFo4VLRc_5vFEHaP_rc7809ltg44_pEA1fpXuBgCaPXm4X2Zx-FEnh11jTxghPUCB1QUybRrdEt6SF9llshmvNrMMIpMjwT1_NVG0qCoFAsFT6Vltc7yO5iJKNCSLzjkuDGJjTi6xonlDgKMSe7flyvk1zujG7SYLy0oybwwKnflA Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: 34950b5c9a734f5cb5820e83dedd4030 Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesActionsTest-456713871 Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:32:57.216039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34950b5c9a734f5cb5820e83dedd4030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34950b5c9a734f5cb5820e83dedd4030", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34950b5c9a734f5cb5820e83dedd4030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34950b5c9a734f5cb5820e83dedd4030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesActionsTest-456713871 Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 34950b5c9a734f5cb5820e83dedd4030 Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesActionsTest-456713871 Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesActionsTest-456713871-project Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: de73f338e6ef4844979ead86ef2bd16c Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesActionsTest-456713871-project Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f could not be found. Aug 07 19:32:57.217524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f'} Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f could not be found. Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:32:57.218297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f could not be found. Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f could not be found. Aug 07 19:32:57.219635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:32:57.222985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] Returning 404 to user: Instance 2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:32:57.225010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f70f707a-4f82-4375-83e8-393faf432b12 tempest-VolumesActionsTest-456713871 tempest-VolumesActionsTest-456713871-project] 10.222.0.17 "GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f" status: 404 len: 111 microversion: 2.1 time: 0.043571 Aug 07 19:32:57.226088 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 420/850] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:32:57 2022] GET /compute/v2.1/servers/2e13d4fd-68f1-4643-8de2-4a65e6ab2a7f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:32:58.143531 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:58.144601 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:58.151044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:58.153228 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:58.154873 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:58.159537 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:58.161095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:58.161779 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:58.357374 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:58.367581 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:58.369575 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:58.371177 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7bbec90b-135a-488b-aa0e-f4586bcf5b09 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.537071 Aug 07 19:32:58.378029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 431/851] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:57 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:32:59.403160 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:32:59.403740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:32:59.411119 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:59.411610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:59.412042 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:59.412750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:32:59.413388 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:32:59.413973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:32:59.604782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:59.632837 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:59.636343 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:32:59.637956 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c6c1df5d-addb-411f-a447-511b40ebf350 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.238913 Aug 07 19:32:59.644103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 421/852] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:32:59 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:00.671266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:00.672546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:00.680495 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:00.682324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:00.683661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:00.684615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:00.685652 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:00.686284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:00.872536 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:00.883052 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:00.885259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:00.886804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7f4639d7-3041-429c-b27d-8c8d4cc933d1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.223366 Aug 07 19:33:00.887615 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 432/853] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:00 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:01.915473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:01.916122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:01.923458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:01.923880 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:01.924386 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:01.925080 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:01.925656 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:01.926088 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:02.060287 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:02.068633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:02.070124 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:02.071306 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d48f1cde-9550-4251-8797-28f95287e96c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1739 microversion: 2.20 time: 0.159977 Aug 07 19:33:02.071881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 422/854] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:01 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:03.095264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:03.095869 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:03.102892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:03.103671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:03.104171 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:03.104698 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:03.105146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:03.105663 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:03.451388 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:03.484188 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:03.487349 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:03.490571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-adb086da-234a-4107-bbba-538c3706c5c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1721 microversion: 2.20 time: 0.398957 Aug 07 19:33:03.491911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 433/855] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:03 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:04.515358 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:04.515978 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:04.523643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:04.530311 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:04.530864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:04.531713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:04.535790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:04.536363 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:04.759761 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:04.770529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:04.772457 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:04.773849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dc9eed33-7575-4299-b68e-3884b68c4fe2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1721 microversion: 2.20 time: 0.262841 Aug 07 19:33:04.774796 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 423/856] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:04 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:33:04.960962 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-81b52ef4-b7be-4fd1-aa18-5200ce52f945 req-7509b22b-d9f0-4a4d-a986-288cc315bcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd99150-d69e-492b-935e-7ca2d4e55b0b", "name": "network-vif-unplugged", "status": "completed", "tag": "f795fad8-24c5-4844-b5bd-2fd41159afb2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:33:04.972502 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-81b52ef4-b7be-4fd1-aa18-5200ce52f945 req-7509b22b-d9f0-4a4d-a986-288cc315bcc6 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:04.973228 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-81b52ef4-b7be-4fd1-aa18-5200ce52f945 req-7509b22b-d9f0-4a4d-a986-288cc315bcc6 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:04.973644 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-81b52ef4-b7be-4fd1-aa18-5200ce52f945 req-7509b22b-d9f0-4a4d-a986-288cc315bcc6 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:04.987540 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-81b52ef4-b7be-4fd1-aa18-5200ce52f945 req-7509b22b-d9f0-4a4d-a986-288cc315bcc6 service nova] Creating event network-vif-unplugged:f795fad8-24c5-4844-b5bd-2fd41159afb2 for instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b on hv-cinder-85032 Aug 07 19:33:04.994718 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-81b52ef4-b7be-4fd1-aa18-5200ce52f945 req-7509b22b-d9f0-4a4d-a986-288cc315bcc6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038002 Aug 07 19:33:04.995879 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 434/857] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:33:05.802638 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:05.804382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:05.811714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:05.813569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:05.814205 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:05.814975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:05.816852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:05.817325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:05.817962 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:06.077779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:06.087678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:06.089727 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:06.094975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e3efe85-d9f1-476c-a6e6-a0e2bc153808 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1664 microversion: 2.20 time: 0.296567 Aug 07 19:33:06.098453 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 424/858] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:05 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1664 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:06.121355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf9d9fa0-c857-4ea2-bfd4-8b12518f516c"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:33:06.124068 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:06.135573 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:06.135953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:06.136817 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:06.138172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:06.138786 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:06.139366 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:06.557543 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8fc636af-55c4-4b22-8733-b445712b4477 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.440328 Aug 07 19:33:06.558046 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 435/859] 10.222.0.17 () {62 vars in 1364 bytes} [Sun Aug 7 19:33:06 2022] POST /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-volume_attachments => generated 188 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 19:33:06.705736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:06.706529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:06.717140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:06.718956 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:06.719939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:06.721003 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:06.722206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:06.722859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:07.163764 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4575e040-fff0-411e-9fc3-62daa2be556f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-volume_attachments/cf9d9fa0-c857-4ea2-bfd4-8b12518f516c" status: 202 len: 0 microversion: 2.20 time: 0.461760 Aug 07 19:33:07.167771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 425/860] 10.222.0.17 () {60 vars in 1457 bytes} [Sun Aug 7 19:33:06 2022] DELETE /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-volume_attachments/cf9d9fa0-c857-4ea2-bfd4-8b12518f516c => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:33:07.378414 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:33:07.379965 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:07.394624 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:07.395505 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:07.397847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:07.399113 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:07.402549 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:07.404440 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:07.450150 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117833) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 19:33:07.551323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e51f0999-ae7e-4eba-bec3-05240aad02b3 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "POST /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/action" status: 202 len: 0 microversion: 2.20 time: 0.177322 Aug 07 19:33:07.551925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 436/861] 10.222.0.17 () {62 vars in 1319 bytes} [Sun Aug 7 19:33:07 2022] POST /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:33:07.560862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:07.561571 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:07.568488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:07.569482 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:07.570269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:07.571194 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:07.572133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:07.572762 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:07.752923 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:07.764991 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:07.769745 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:07.771397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-351965f5-5648-43d3-92cd-42aed46535c1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1672 microversion: 2.20 time: 0.214678 Aug 07 19:33:07.772869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 426/862] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:07 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:08.800104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:08.801487 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:08.818349 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:08.821110 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:08.821726 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:08.822699 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:08.823412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:08.823518 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:09.110210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:09.119279 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:09.124168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:09.131092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5cf27b9e-04ac-4ead-a77f-c9935f635fa1 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.335944 Aug 07 19:33:09.134212 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 437/863] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:08 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:10.160479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:10.161201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:10.168230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:10.168720 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:10.169153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:10.170219 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:10.170673 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:10.171119 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:10.361929 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:10.372984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:10.373718 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:10.376046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6b920988-c9c0-4dac-9042-59de8677b74b tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.219853 Aug 07 19:33:10.377002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 427/864] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:10 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:11.403808 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:11.407230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:11.422563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:11.423239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:11.424664 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:11.426168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:11.427123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:11.428153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:11.604895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:11.613254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:11.614747 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:11.615938 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c6a10dbf-52c6-4f3a-b53d-d69c45f7b28e tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.218854 Aug 07 19:33:11.616499 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 438/865] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:11 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:12.639284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:12.640841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:12.651730 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:12.652753 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:12.653422 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:12.654611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:12.655529 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:12.656239 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:12.929433 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:12.947129 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:12.956327 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:12.959147 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f594dd7f-2eff-466c-8545-0bd093d73534 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.323789 Aug 07 19:33:12.960471 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 428/866] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:12 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:33:14.044023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:14.044680 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:14.052381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:14.053050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:14.053568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:14.054441 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:14.055035 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:14.055729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:14.090116 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:14.339796 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:14.355283 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:14.358037 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:14.361150 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-89f295a7-964e-48a6-ace8-34928af48e0a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.367191 Aug 07 19:33:14.373181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 439/867] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:13 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:15.392586 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:15.396797 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:15.428810 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:15.431678 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:15.436723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:15.440180 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:15.443130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:15.444733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:15.848077 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:15.860702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:15.862826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:15.880717 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-47d5e8fc-7faa-4ac9-9703-7ac34b62308c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.483074 Aug 07 19:33:15.882448 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 429/868] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:15 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:16.907418 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:16.909140 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:16.917611 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:16.918931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:16.919605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:16.921007 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:16.922372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:16.924992 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:17.365265 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:17.401054 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:17.405508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:17.413605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ba2a049b-f3b0-4321-9119-dadd06582901 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.511200 Aug 07 19:33:17.439192 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 440/869] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:16 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:18.117994 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:18.118613 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:18.128588 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-716c890c-d301-4517-94fd-be42b0d22c0f req-4b050310-f6b3-44a0-9955-7e342dba886d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6", "tag": "a441108c-e43e-4ecc-b113-5e6d2d30de08"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:33:18.138987 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:18.139685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:18.140281 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:18.141871 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-716c890c-d301-4517-94fd-be42b0d22c0f req-4b050310-f6b3-44a0-9955-7e342dba886d service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:18.142801 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-716c890c-d301-4517-94fd-be42b0d22c0f req-4b050310-f6b3-44a0-9955-7e342dba886d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:18.143409 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-716c890c-d301-4517-94fd-be42b0d22c0f req-4b050310-f6b3-44a0-9955-7e342dba886d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:18.151836 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:18.152492 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:18.153008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:18.158810 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:18.159937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-716c890c-d301-4517-94fd-be42b0d22c0f req-4b050310-f6b3-44a0-9955-7e342dba886d service nova] Creating event network-changed:a441108c-e43e-4ecc-b113-5e6d2d30de08 for instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 on hv-cinder-85032 Aug 07 19:33:18.167631 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-716c890c-d301-4517-94fd-be42b0d22c0f req-4b050310-f6b3-44a0-9955-7e342dba886d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045588 Aug 07 19:33:18.173385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 441/870] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:33:18.285825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:33:18.451687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:18.453135 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:18.478678 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:18.487444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:18.496660 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:18.500739 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:18.503338 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:18.504635 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:18.557996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a3e69b03-f8f3-4cfc-a22e-4760d036f762 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "DELETE /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 204 len: 0 microversion: 2.1 time: 0.443371 Aug 07 19:33:18.562953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 430/871] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:33:18 2022] DELETE /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:33:18.570092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:18.571125 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:18.578029 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:18.578841 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:18.579632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:18.580871 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:18.581565 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:18.582162 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:19.458374 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:19.469637 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:19.472422 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-645883ca-0bc7-4968-aeba-a00df469ca70 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.907623 Aug 07 19:33:19.478687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 431/872] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:33:18 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:33:19.497413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:19.500722 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:19.502057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1bf177f9-df70-459e-9003-0b208591a1c5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 1.057389 Aug 07 19:33:19.504637 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 442/873] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:18 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:20.503392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:20.504457 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:20.532558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:20.533320 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:20.538861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:20.539471 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:20.539942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:20.548753 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:20.555659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:20.556993 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:20.564755 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:20.578640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:20.579387 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:20.582559 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:20.583515 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:20.584888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:20.971034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:20.988222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:20.997239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:21.001982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e16c8488-5a0a-427b-96e7-66c4e7f5a7a2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.475647 Aug 07 19:33:21.007292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 443/874] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:20 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:33:21.159306 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:21.180271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-880c162b-d8c2-4ee0-b986-3d011eb4ea1e tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 0.681524 Aug 07 19:33:21.197873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 432/875] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:33:20 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:33:22.035548 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:22.036246 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:22.066713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:22.073502 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:22.074086 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:22.074952 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:22.075469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:22.075948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:22.205623 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:22.206412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:22.227875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:22.228537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:22.229145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:22.230052 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:22.230479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:22.252543 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:23.352419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:23.378497 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:23.387260 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:23.388561 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a494c77a-2729-48ec-8251-36770631d23a tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 1.357102 Aug 07 19:33:23.397684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 444/876] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:22 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:33:23.415360 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-704d8d0a-fc54-454a-9f6d-7017f91a1ae0 req-685df9a2-d3dc-4fcd-8544-1fb0c5f00e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6", "name": "network-vif-deleted", "tag": "a441108c-e43e-4ecc-b113-5e6d2d30de08"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:33:23.464954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-704d8d0a-fc54-454a-9f6d-7017f91a1ae0 req-685df9a2-d3dc-4fcd-8544-1fb0c5f00e05 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:23.465846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-704d8d0a-fc54-454a-9f6d-7017f91a1ae0 req-685df9a2-d3dc-4fcd-8544-1fb0c5f00e05 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:23.466563 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-704d8d0a-fc54-454a-9f6d-7017f91a1ae0 req-685df9a2-d3dc-4fcd-8544-1fb0c5f00e05 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:23.504202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-704d8d0a-fc54-454a-9f6d-7017f91a1ae0 req-685df9a2-d3dc-4fcd-8544-1fb0c5f00e05 service nova] Creating event network-vif-deleted:a441108c-e43e-4ecc-b113-5e6d2d30de08 for instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 on hv-cinder-85032 Aug 07 19:33:23.516756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-704d8d0a-fc54-454a-9f6d-7017f91a1ae0 req-685df9a2-d3dc-4fcd-8544-1fb0c5f00e05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114732 Aug 07 19:33:23.527450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 445/877] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:33:23.633368 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:23.654776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-74014500-673c-413e-8158-2712d36a6209 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1567 microversion: 2.1 time: 1.457000 Aug 07 19:33:23.655516 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 433/878] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:33:22 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1567 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:33:24.424560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:24.425461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:24.443763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:24.445913 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:24.447621 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:24.451868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:24.454720 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:24.457976 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:24.677489 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:24.678747 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:24.698672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:24.699577 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:24.700274 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:24.701380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:24.702088 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:24.702743 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:24.784339 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:24.786660 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:24.787485 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:24.788248 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lazy-loading 'fault' on Instance uuid 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:33:25.190122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbec912e4d5c4c6aabed5a98b6aa632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5e8fba8d65419393ba9829cafdd5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:25.201569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99ef3e0a-0657-48d5-98a0-2ac4f7c71bd7 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 200 len: 1179 microversion: 2.1 time: 0.527956 Aug 07 19:33:25.205072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 434/879] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:33:24 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 1179 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:33:25.431381 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:25.442585 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:25.463444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:25.464908 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fbcd6360-bb21-4a65-b453-dfb6f863604c tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 1.050559 Aug 07 19:33:25.465469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 446/880] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:24 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:26.242799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:26.244645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] [instance: 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:26.258653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:26.262208 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:26.264809 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:26.267774 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:26.271495 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:26.272528 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:26.331090 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] HTTP exception thrown: Instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 could not be found. Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Request method failure captured: Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 HTTP/1.1 Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BIya_rb43A31ZysTdy0_wrigdA40gWF_ld8rCPJgYBL6IzGp5yNUrOncYFDKAqswWg67cKfClOcakKkR4_pI6ursyJk_ulvaEliZxy-ub_MFvMrCTZpH2FaJ_X7P_1vgk4EPn_MTPNyEKAhfRHeGwz3LklSTqNkRq8zb-AKsV80m24 Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: 6e5e8fba8d65419393ba9829cafdd5b9 Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestShelveInstance-1714515393 Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:33:26.337271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e5e8fba8d65419393ba9829cafdd5b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e5e8fba8d65419393ba9829cafdd5b9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e5e8fba8d65419393ba9829cafdd5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e5e8fba8d65419393ba9829cafdd5b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestShelveInstance-1714515393 Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6e5e8fba8d65419393ba9829cafdd5b9 Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestShelveInstance-1714515393 Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-TestShelveInstance-1714515393-project Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: dbec912e4d5c4c6aabed5a98b6aa632d Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestShelveInstance-1714515393-project Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 could not be found. Aug 07 19:33:26.338829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6'} Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 could not be found. Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:33:26.339659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 could not be found. Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 could not be found. Aug 07 19:33:26.341170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:33:26.345043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Returning 404 to user: Instance 63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:33:26.351685 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a24d77ff-ecc5-4e15-aa1f-54f4ffe2d640 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6" status: 404 len: 111 microversion: 2.1 time: 0.110790 Aug 07 19:33:26.355398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 435/881] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:33:26 2022] GET /compute/v2.1/servers/63eb090f-f0b8-4a9b-bbfc-f1373abfa6f6 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:33:26.494119 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:26.494119 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:26.501161 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:26.527785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:26.530493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:26.531758 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:26.532926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:26.536228 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:26.536902 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:26.833708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-851be411-b235-46ef-97ed-5db399f9cc43 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] Calling method '.version_select at 0x7fd476cd05e0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:26.889833 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-851be411-b235-46ef-97ed-5db399f9cc43 tempest-TestShelveInstance-1714515393 tempest-TestShelveInstance-1714515393-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1815908904" status: 202 len: 0 microversion: 2.1 time: 0.060829 Aug 07 19:33:26.898746 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 436/882] 10.222.0.17 () {58 vars in 1254 bytes} [Sun Aug 7 19:33:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1815908904 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:33:27.068066 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:27.084285 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:27.088958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:27.092734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7ca7d08c-b4cb-4d85-a150-834fc7c33acc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.605148 Aug 07 19:33:27.096418 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 447/883] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:26 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:33:28.140061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:28.140825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:28.156765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:28.157261 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:28.157706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:28.168855 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:28.172620 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:28.173114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:29.176566 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:29.187929 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:29.189898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:29.191546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b3b06d43-a2c1-454b-9554-59240c7d0088 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 1.055851 Aug 07 19:33:29.192696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 437/884] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:28 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:30.225959 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:30.229190 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:30.261667 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:30.262156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:30.262594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:30.265754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:30.266333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:30.266822 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:30.749633 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:30.777723 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:30.781023 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:30.783571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4baaddb7-4e95-4424-9fb6-b4e2516cd8ab tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.572063 Aug 07 19:33:30.785861 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 448/885] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:30 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:31.809140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:31.810568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:31.823736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:31.824716 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:31.826048 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:31.829021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:31.829734 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:31.832631 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:32.329637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:32.384874 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:32.390362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:32.392056 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b66594d1-9c4a-47ba-814b-87cb903b2000 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.586987 Aug 07 19:33:32.393464 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 438/886] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:31 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:33.238242 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-84b6ca97-74d1-48c2-b5ac-dcf5407cf6bd req-397cbbe6-b9ad-4a7b-a3ec-c266d2142eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd99150-d69e-492b-935e-7ca2d4e55b0b", "name": "network-vif-plugged", "status": "completed", "tag": "f795fad8-24c5-4844-b5bd-2fd41159afb2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:33:33.255109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-84b6ca97-74d1-48c2-b5ac-dcf5407cf6bd req-397cbbe6-b9ad-4a7b-a3ec-c266d2142eee service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:33.255971 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-84b6ca97-74d1-48c2-b5ac-dcf5407cf6bd req-397cbbe6-b9ad-4a7b-a3ec-c266d2142eee service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:33.256806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-84b6ca97-74d1-48c2-b5ac-dcf5407cf6bd req-397cbbe6-b9ad-4a7b-a3ec-c266d2142eee service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:33.292075 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-84b6ca97-74d1-48c2-b5ac-dcf5407cf6bd req-397cbbe6-b9ad-4a7b-a3ec-c266d2142eee service nova] Creating event network-vif-plugged:f795fad8-24c5-4844-b5bd-2fd41159afb2 for instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b on hv-cinder-85032 Aug 07 19:33:33.306751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-84b6ca97-74d1-48c2-b5ac-dcf5407cf6bd req-397cbbe6-b9ad-4a7b-a3ec-c266d2142eee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072318 Aug 07 19:33:33.311163 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 449/887] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:33:33.457834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:33.459793 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:33.474875 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:33.476360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:33.480259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:33.488377 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:33.489885 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:33.491140 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:33.901160 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:33.925046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:33.933418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:33.938598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-473b4dbc-b61d-414b-81f0-2e0df70968f5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.492886 Aug 07 19:33:33.940092 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 439/888] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:33 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:34.969885 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:34.971211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:34.983835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:34.985415 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:34.986236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:34.987494 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:34.988380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:34.989478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:35.287144 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:35.313412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:35.325269 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:35.327849 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ccfa0271-1a90-4b7e-9416-602e7ed5f072 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.367254 Aug 07 19:33:35.328983 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 450/889] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:34 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:36.374211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:36.378103 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:36.407077 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:36.409914 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:36.410931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:36.411640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:36.412986 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:36.413835 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:36.414688 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:36.792070 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:36.820848 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:36.826132 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:36.829432 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1813b2ef-7e54-4259-95c5-b6f879eb3a3f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1730 microversion: 2.20 time: 0.462654 Aug 07 19:33:36.832232 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 440/890] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:36 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1730 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:33:37.878530 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:33:37.885146 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:33:37.932472 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:37.934268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:37.935828 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:37.942743 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:33:37.946267 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:33:37.958897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:33:38.445210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:38.499457 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:38.504153 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:33:38.506386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-25c6b4bb-9bf1-45d5-baf2-78285d0fd601 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1717 microversion: 2.20 time: 0.636615 Aug 07 19:33:38.514292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 451/891] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:33:37 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1717 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:33:45.955909 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93492127-cee2-45d5-85f9-d38b64b42e9d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Action: 'create', calling method: .version_select at 0x7fd476b4d8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1892901741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX1IrlyVeHgKMnfMbjrQEgJNyCfTYtwyeuMuJOdcEVYHerEUFE0Y7hy3sdNxZdPV9M4q6QoTdG4t/sm9QwlH0nqSW9HRMcRFCzy9alSRgXJs7dK4WcpR39BTscANJD3ow=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:33:46.029212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-93492127-cee2-45d5-85f9-d38b64b42e9d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for project bdc0726934c64051b49ed81a2abc5c89. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:33:46.042427 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-93492127-cee2-45d5-85f9-d38b64b42e9d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for user 656a586e718543bfb095790441c28fe8 and project bdc0726934c64051b49ed81a2abc5c89. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:33:46.087334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-93492127-cee2-45d5-85f9-d38b64b42e9d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.523013 Aug 07 19:33:46.088834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 441/892] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:33:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:03.263203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-702190495", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1892901741", "security_groups": [{"name": "tempest-secgroup-smoke-501637307"}], "block_device_mapping_v2": [{"uuid": "981bdea0-358a-4e37-a9eb-79ef57645663", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2bbd619-d45a-4365-90a9-8061571047c4"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:03.288552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=9 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:03.290529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=62 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:03.482715 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] validate_networks() for [('c2bbd619-d45a-4365-90a9-8061571047c4', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:34:04.125443 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:34:04.136907 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:34:04.137895 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:34:04.138683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:34:04.139667 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:34:04.202004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:04.202533 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:04.203013 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:04.204370 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:04.215373 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:04.216170 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:04.252441 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for project bdc0726934c64051b49ed81a2abc5c89. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:34:04.263885 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for user 656a586e718543bfb095790441c28fe8 and project bdc0726934c64051b49ed81a2abc5c89. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:34:04.396165 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:34:04.399657 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='981bdea0-358a-4e37-a9eb-79ef57645663',volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:34:04.638478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1f13b9dd-df05-4546-b821-e255fe1f86ff tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.381082 Aug 07 19:34:04.641988 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 452/893] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:34:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:34:04.656389 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:04.659855 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:04.660593 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:04.668349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3cbc561f-f169-4c2f-a2a7-0de76ce08f37 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:04.670024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3cbc561f-f169-4c2f-a2a7-0de76ce08f37 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:04.793994 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3cbc561f-f169-4c2f-a2a7-0de76ce08f37 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:04.823289 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3cbc561f-f169-4c2f-a2a7-0de76ce08f37 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1094 microversion: 2.1 time: 0.158980 Aug 07 19:34:04.837866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 442/894] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:04 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1094 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:05.861091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:05.862010 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:05.881525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:05.882077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:05.882523 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:05.884770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:05.885322 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:05.885763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:06.071637 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:06.096538 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bd2db97c-1d1f-4d98-9c1f-29a0b4e9e77f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1192 microversion: 2.1 time: 0.239203 Aug 07 19:34:06.097940 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 453/895] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:05 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1192 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:07.119483 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:07.120318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:07.129974 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:07.131882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:07.133961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:07.136422 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:07.138400 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:07.139672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:07.279157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:07.325807 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-507ccb90-80f7-4319-9174-fc0317e957e8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1210 microversion: 2.1 time: 0.210205 Aug 07 19:34:07.327555 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 443/896] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:07 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1210 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:08.354919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:08.356391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:08.367642 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:08.368433 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:08.369870 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:08.370899 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:08.371910 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:08.372551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:08.573888 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:08.586474 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-879afd08-c467-4b8c-957c-3c1c6b2d6e87 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.236120 Aug 07 19:34:08.587681 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 454/897] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:08 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:09.626066 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1f1941ed-4a49-4627-9bea-b86e6d027439 req-0f22e5ac-d7d3-4b5e-a5e4-e91e79f6177d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf", "tag": "5c84fb20-a272-4feb-a394-fcc1548d2028"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:09.631611 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:09.635626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:09.671580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:09.672773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:09.677194 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:09.680795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:09.681804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:09.682570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:09.688635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1f1941ed-4a49-4627-9bea-b86e6d027439 req-0f22e5ac-d7d3-4b5e-a5e4-e91e79f6177d service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:09.689384 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1f1941ed-4a49-4627-9bea-b86e6d027439 req-0f22e5ac-d7d3-4b5e-a5e4-e91e79f6177d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:09.690076 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1f1941ed-4a49-4627-9bea-b86e6d027439 req-0f22e5ac-d7d3-4b5e-a5e4-e91e79f6177d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:09.725867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1f1941ed-4a49-4627-9bea-b86e6d027439 req-0f22e5ac-d7d3-4b5e-a5e4-e91e79f6177d service nova] Creating event network-changed:5c84fb20-a272-4feb-a394-fcc1548d2028 for instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf on hv-cinder-85032 Aug 07 19:34:09.770477 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1f1941ed-4a49-4627-9bea-b86e6d027439 req-0f22e5ac-d7d3-4b5e-a5e4-e91e79f6177d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161548 Aug 07 19:34:09.771578 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 444/898] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:10.046443 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:10.068055 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1d492433-5e17-455b-bac5-b1bc962e63b6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.461453 Aug 07 19:34:10.069152 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 455/899] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:09 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:11.104931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:11.105795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:11.112927 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:11.113754 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:11.114199 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:11.114958 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:11.115506 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:11.116193 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:11.327883 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:11.342663 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c5a137ed-bc3b-4362-879a-6d8e844e736f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.243538 Aug 07 19:34:11.343781 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 445/900] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:11 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:11.931134 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:11.935296 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:11.946667 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:11.948058 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:11.949165 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:11.950854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:11.952020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:11.953041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:12.017466 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-12027345-b8b5-40be-aeea-27903ddfbb03 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.094448 Aug 07 19:34:12.029004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 456/901] 10.222.0.17 () {60 vars in 1343 bytes} [Sun Aug 7 19:34:11 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:12.140312 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:12.143024 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:12.158248 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:12.159655 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:12.160877 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:12.162665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:12.164154 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:12.165212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:12.222960 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:34:12.376625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:12.378411 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:12.381052 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-691c9cfd-7bbe-4b35-af77-96ce5da9e761 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 204 len: 0 microversion: 2.20 time: 0.248784 Aug 07 19:34:12.384058 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 446/902] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Aug 7 19:34:12 2022] DELETE /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 19:34:12.394982 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:12.396930 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:12.397610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:12.398544 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:12.398879 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:12.399584 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:12.399869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:12.400029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:12.412697 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:12.413546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:12.414552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:12.416030 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:12.417240 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:12.418314 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:12.667592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:12.676509 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5482bdb0-0f9e-45fb-af35-af3b7f2cebe4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.305733 Aug 07 19:34:12.681367 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 457/903] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:12 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:12.693180 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:12.704510 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:12.706487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:12.707946 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9be190e8-cd9f-44af-8886-6c2a7a2ac9dc tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.319267 Aug 07 19:34:12.709068 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 447/904] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:34:12 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:34:13.706245 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:13.712866 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:13.728635 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:13.729859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:13.731291 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:13.743591 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:13.745365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:13.747520 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:13.748901 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:13.752341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:13.779694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:13.781084 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:13.782059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:13.791862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:13.793310 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:13.795156 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:14.231444 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:14.289206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:14.352174 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:14.362463 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ad802534-b8b8-4532-996c-f05178abf73b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.665248 Aug 07 19:34:14.362463 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 458/905] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:13 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:14.376403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:14.394063 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:14.402619 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:14.404401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-24a7a178-5fb0-487d-b5fc-2a8acc928556 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1723 microversion: 2.20 time: 0.670513 Aug 07 19:34:14.406556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 448/906] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:34:13 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1723 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 19:34:15.334963 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-96fc3904-9b52-4feb-8912-0cdde030a294 req-19b16a74-9af9-4812-ace2-a5521ff9f60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd99150-d69e-492b-935e-7ca2d4e55b0b", "name": "network-vif-deleted", "tag": "f795fad8-24c5-4844-b5bd-2fd41159afb2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:15.354858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-96fc3904-9b52-4feb-8912-0cdde030a294 req-19b16a74-9af9-4812-ace2-a5521ff9f60c service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:15.359737 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-96fc3904-9b52-4feb-8912-0cdde030a294 req-19b16a74-9af9-4812-ace2-a5521ff9f60c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:15.360553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-96fc3904-9b52-4feb-8912-0cdde030a294 req-19b16a74-9af9-4812-ace2-a5521ff9f60c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:15.392954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-96fc3904-9b52-4feb-8912-0cdde030a294 req-19b16a74-9af9-4812-ace2-a5521ff9f60c service nova] Creating event network-vif-deleted:f795fad8-24c5-4844-b5bd-2fd41159afb2 for instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b on hv-cinder-85032 Aug 07 19:34:15.396073 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:15.402580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-96fc3904-9b52-4feb-8912-0cdde030a294 req-19b16a74-9af9-4812-ace2-a5521ff9f60c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071395 Aug 07 19:34:15.406467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 459/907] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:34:15.414259 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:15.429358 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:15.435279 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:15.437367 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:15.438995 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:15.443658 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:15.445324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:15.447076 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:15.447894 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:15.448948 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:15.455468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:15.456447 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:15.457143 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:15.458137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:15.458859 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:15.459523 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:15.691293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:15.704798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:15.707009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb092d77de334d3ab631a42979460c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12435b63a424deeb1cca3ba959245a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:15.709201 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1318e56d-915c-4dd6-a666-c013bbd0833f tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 200 len: 1366 microversion: 2.20 time: 0.267173 Aug 07 19:34:15.714830 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 460/908] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:34:15 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 19:34:16.031463 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:16.081624 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-131f11c4-4bf5-47d5-9ccb-2eaf91f01c35 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.700298 Aug 07 19:34:16.096039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 449/909] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:15 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:16.741497 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:16.742598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:16.773838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:16.775196 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:16.776249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:16.778198 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:16.779109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:16.779754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:16.825921 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] HTTP exception thrown: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Request method failure captured: Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b HTTP/1.1 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BI8a1r0ISxKjp_9sED_nEaT575TBZ9rLXOPZDrP3raCX9eicW92rK3_oC3s-sL-1dRQ268LMvqYOcZQVxyA7jLlVOJytJU-i9cwlZxjxEWqTOcvfDJ_-ba4weSfwuOgGZIJIk6IvCyMvbA8YQAQbIQfIVunRRwIxNYYQp0XvClkkl8 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:34:16.833173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12435b63a424deeb1cca3ba959245a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: bb092d77de334d3ab631a42979460c59 Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:16.835897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '0bd99150-d69e-492b-935e-7ca2d4e55b0b'} Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:34:16.837407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:16.841708 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:16.851324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Returning 404 to user: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:34:16.853116 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7311142c-6dac-4eea-98bc-2a493d0b10d5 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 404 len: 111 microversion: 2.20 time: 0.118910 Aug 07 19:34:16.861741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 461/910] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:34:16 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:34:16.871708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-142972fb-f2bc-4d8c-98b7-ce195b522ed2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '.version_select at 0x7fd476d7bee0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:16.970643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-142972fb-f2bc-4d8c-98b7-ce195b522ed2 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-764300850" status: 204 len: 0 microversion: 2.20 time: 0.107629 Aug 07 19:34:16.972279 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 450/911] 10.222.0.17 () {60 vars in 1259 bytes} [Sun Aug 7 19:34:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-764300850 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 19:34:17.131429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:17.132118 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:17.144406 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:17.145228 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:17.146094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:17.147249 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:17.147929 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:17.148849 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:17.458560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:17.470919 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8d1bc2bd-fd16-4ebb-883b-0c67e00eb661 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.351455 Aug 07 19:34:17.472106 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 462/912] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:17 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:18.511799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:18.513757 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:18.546073 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:18.546908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:18.547458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:18.554035 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:18.554985 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:18.555736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:19.371142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:19.386036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7a949766-2f43-4a39-9a18-39bc0904f9dd tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.880500 Aug 07 19:34:19.388453 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 451/913] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:18 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:19.802392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:19.803465 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:19.815178 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:19.822795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:19.823790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:19.825150 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:19.825949 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:19.826647 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:19.856764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] HTTP exception thrown: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Request method failure captured: Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b HTTP/1.1 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BI8a1r0ISxKjp_9sED_nEaT575TBZ9rLXOPZDrP3raCX9eicW92rK3_oC3s-sL-1dRQ268LMvqYOcZQVxyA7jLlVOJytJU-i9cwlZxjxEWqTOcvfDJ_-ba4weSfwuOgGZIJIk6IvCyMvbA8YQAQbIQfIVunRRwIxNYYQp0XvClkkl8 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:34:19.860398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12435b63a424deeb1cca3ba959245a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: bb092d77de334d3ab631a42979460c59 Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.863038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '0bd99150-d69e-492b-935e-7ca2d4e55b0b'} Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:34:19.865036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.867253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.871781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Returning 404 to user: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:34:19.871781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-635f75f9-9b5c-4a03-8b32-4b906aa47e51 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 404 len: 111 microversion: 2.20 time: 0.073698 Aug 07 19:34:19.871781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 463/914] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Aug 7 19:34:19 2022] DELETE /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:34:19.878347 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:19.879072 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 0bd99150-d69e-492b-935e-7ca2d4e55b0b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:19.892409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:19.892761 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:19.893318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:19.896872 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:19.896872 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:19.896872 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:19.930653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] HTTP exception thrown: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Request method failure captured: Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b HTTP/1.1 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BI8a1r0ISxKjp_9sED_nEaT575TBZ9rLXOPZDrP3raCX9eicW92rK3_oC3s-sL-1dRQ268LMvqYOcZQVxyA7jLlVOJytJU-i9cwlZxjxEWqTOcvfDJ_-ba4weSfwuOgGZIJIk6IvCyMvbA8YQAQbIQfIVunRRwIxNYYQp0XvClkkl8 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:34:19.934694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12435b63a424deeb1cca3ba959245a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: bb092d77de334d3ab631a42979460c59 Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.937479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '0bd99150-d69e-492b-935e-7ca2d4e55b0b'} Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:34:19.940098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. Aug 07 19:34:19.944202 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:19.947621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Returning 404 to user: Instance 0bd99150-d69e-492b-935e-7ca2d4e55b0b could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:34:19.947621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f948451a-9db5-4000-8276-d23fe688a076 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b" status: 404 len: 111 microversion: 2.20 time: 0.063124 Aug 07 19:34:19.947621 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 452/915] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:34:19 2022] GET /compute/v2.1/servers/0bd99150-d69e-492b-935e-7ca2d4e55b0b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:34:20.426819 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:20.439028 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:20.454263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:20.455253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:20.457553 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:20.460805 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:20.462281 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:20.463892 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:20.715206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:20.732483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dff13ed3-b43d-4150-a5af-3eb71203721e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.313251 Aug 07 19:34:20.744020 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 464/916] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:20 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:21.254136 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:21.254969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:21.267397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:21.268984 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:21.270171 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:21.271871 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:21.273950 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:21.275047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:21.298666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] HTTP exception thrown: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Request method failure captured: Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 HTTP/1.1 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BI8a1r0ISxKjp_9sED_nEaT575TBZ9rLXOPZDrP3raCX9eicW92rK3_oC3s-sL-1dRQ268LMvqYOcZQVxyA7jLlVOJytJU-i9cwlZxjxEWqTOcvfDJ_-ba4weSfwuOgGZIJIk6IvCyMvbA8YQAQbIQfIVunRRwIxNYYQp0XvClkkl8 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:34:21.301969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12435b63a424deeb1cca3ba959245a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: bb092d77de334d3ab631a42979460c59 Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.305166 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '20345500-7cc0-4cd4-9c7a-35fc42ba4a32'} Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:34:21.311944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.316417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.321547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Returning 404 to user: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:34:21.321547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6fb74a9-6c9d-47e0-97e8-67bf93ea7eaf tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 404 len: 111 microversion: 2.20 time: 0.057879 Aug 07 19:34:21.321547 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 453/917] 10.222.0.17 () {60 vars in 1280 bytes} [Sun Aug 7 19:34:21 2022] DELETE /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:34:21.322026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:21.325289 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] [instance: 20345500-7cc0-4cd4-9c7a-35fc42ba4a32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:21.339295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:21.346870 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:21.348264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:21.349372 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:21.350099 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:21.350705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:21.383701 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] HTTP exception thrown: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Request method failure captured: Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 HTTP/1.1 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BI8a1r0ISxKjp_9sED_nEaT575TBZ9rLXOPZDrP3raCX9eicW92rK3_oC3s-sL-1dRQ268LMvqYOcZQVxyA7jLlVOJytJU-i9cwlZxjxEWqTOcvfDJ_-ba4weSfwuOgGZIJIk6IvCyMvbA8YQAQbIQfIVunRRwIxNYYQp0XvClkkl8 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:34:21.388327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12435b63a424deeb1cca3ba959245a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12435b63a424deeb1cca3ba959245a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d12435b63a424deeb1cca3ba959245a4 Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710650480 Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: bb092d77de334d3ab631a42979460c59 Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710650480-project Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.389884 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '20345500-7cc0-4cd4-9c7a-35fc42ba4a32'} Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:34:21.390654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. Aug 07 19:34:21.392574 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:34:21.394160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] Returning 404 to user: Instance 20345500-7cc0-4cd4-9c7a-35fc42ba4a32 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:34:21.394160 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-69908831-182a-44c1-a8f9-2b91f2758671 tempest-AttachVolumeShelveTestJSON-710650480 tempest-AttachVolumeShelveTestJSON-710650480-project] 10.222.0.17 "GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32" status: 404 len: 111 microversion: 2.20 time: 0.077574 Aug 07 19:34:21.396707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 465/918] 10.222.0.17 () {60 vars in 1277 bytes} [Sun Aug 7 19:34:21 2022] GET /compute/v2.1/servers/20345500-7cc0-4cd4-9c7a-35fc42ba4a32 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 19:34:21.498186 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c033add2-d07a-4311-a090-831b598c4895 req-a30c4447-a6ba-4d53-ba5f-ca568a7535ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf", "name": "network-vif-plugged", "status": "completed", "tag": "5c84fb20-a272-4feb-a394-fcc1548d2028"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:21.531392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c033add2-d07a-4311-a090-831b598c4895 req-a30c4447-a6ba-4d53-ba5f-ca568a7535ba service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:21.532656 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c033add2-d07a-4311-a090-831b598c4895 req-a30c4447-a6ba-4d53-ba5f-ca568a7535ba service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:21.533672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c033add2-d07a-4311-a090-831b598c4895 req-a30c4447-a6ba-4d53-ba5f-ca568a7535ba service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:21.559153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c033add2-d07a-4311-a090-831b598c4895 req-a30c4447-a6ba-4d53-ba5f-ca568a7535ba service nova] Creating event network-vif-plugged:5c84fb20-a272-4feb-a394-fcc1548d2028 for instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf on hv-cinder-85032 Aug 07 19:34:21.565564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c033add2-d07a-4311-a090-831b598c4895 req-a30c4447-a6ba-4d53-ba5f-ca568a7535ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083622 Aug 07 19:34:21.566652 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 454/919] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:21.755271 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:21.756193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:21.769906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:21.774445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:21.775174 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:21.778124 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:21.778756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:21.779378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:21.985141 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:21.994021 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5cb13881-c7ef-4a71-a8b8-b124d4688571 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.243073 Aug 07 19:34:21.996368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 466/920] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:21 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:23.018442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:23.019296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:23.029082 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:23.029688 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:23.030388 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:23.031579 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:23.032245 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:23.033524 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:23.364916 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:23.374330 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-990e79fe-81de-43a8-a02b-a374565145ae tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1265 microversion: 2.1 time: 0.361607 Aug 07 19:34:23.376032 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 455/921] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:23 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:24.164244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a45e455-9726-45ba-b6c8-e3ea68bb7874 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Action: 'create', calling method: .version_select at 0x7fd476b6d430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1205919276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuX+XBKMmMJIv46cB8v9t/9E2Lun6xE/1v8Zl5nJVMS6MRrFIzeaacWbe1oJcrqmhQR03glk4PsYZD7OMUFCwWbKhuf/crLOQr3KMe7cwxyU1e4qw0I3MNMnZ4nUub/EA=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:24.183267 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-2a45e455-9726-45ba-b6c8-e3ea68bb7874 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Getting quotas for project 1b16920c2e384c9ca20252917204b8ab. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:34:24.188389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-2a45e455-9726-45ba-b6c8-e3ea68bb7874 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Getting quotas for user 523936e9a8ca49b9805fa110a1841d64 and project 1b16920c2e384c9ca20252917204b8ab. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:34:24.219291 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a45e455-9726-45ba-b6c8-e3ea68bb7874 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060979 Aug 07 19:34:24.219891 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 467/922] 10.222.0.17 () {60 vars in 1159 bytes} [Sun Aug 7 19:34:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:24.309881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2137867746", "imageRef": "f9c70841-975a-4268-b7de-d4c0731016ec", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1205919276", "networks": [{"uuid": "c0675d87-3cb3-4cc0-943c-33992407cdef"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:24.389715 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] validate_networks() for [('c0675d87-3cb3-4cc0-943c-33992407cdef', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:34:24.397053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:24.398105 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:24.405311 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:24.405873 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:24.406315 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:24.407037 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:24.407797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:24.408270 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:24.828725 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:24.845130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe5cee9b-5cff-44f4-857f-3bacf76db396 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1452 microversion: 2.1 time: 0.452605 Aug 07 19:34:24.845935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 468/923] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:24 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1452 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:24.868024 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:24.868825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:24.879077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:24.879700 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:24.880244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:24.881256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:24.881792 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:24.882301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:25.236475 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:25.250636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-df19968c-ed12-4481-8e08-56df58e21f88 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1452 microversion: 2.1 time: 0.386524 Aug 07 19:34:25.253777 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 469/924] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:24 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1452 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:25.443369 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:34:25.444285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:34:25.445366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:34:25.446104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:34:25.447160 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:34:25.463359 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:25.464272 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:25.465068 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:25.466660 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:25.467862 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:25.468671 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:25.503939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Getting quotas for project 1b16920c2e384c9ca20252917204b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:34:25.512070 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Getting quotas for user 523936e9a8ca49b9805fa110a1841d64 and project 1b16920c2e384c9ca20252917204b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:34:25.534337 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:34:25.538786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9c70841-975a-4268-b7de-d4c0731016ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:34:25.623347 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-578107ae-7f62-4667-98e5-6aa2bd037aa5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317099 Aug 07 19:34:25.635271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 456/925] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:34:25.647460 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-652c4ddf-cf5e-4c28-ad73-be04cf2a8bcd tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:25.654284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-652c4ddf-cf5e-4c28-ad73-be04cf2a8bcd tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:25.830921 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-652c4ddf-cf5e-4c28-ad73-be04cf2a8bcd tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:25.849091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-652c4ddf-cf5e-4c28-ad73-be04cf2a8bcd tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1259 microversion: 2.1 time: 0.211081 Aug 07 19:34:25.851098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 470/926] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:25 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:26.887416 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:26.888523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:26.897732 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:26.898804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:26.899365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:26.900330 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:26.900647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:26.901074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:27.000359 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:27.009571 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f09cf5c9-3f91-47ed-a780-9ec3cfab7f19 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1311 microversion: 2.1 time: 0.127073 Aug 07 19:34:27.012895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 457/927] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:26 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:28.041096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:28.043391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:28.057252 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:28.057883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:28.058341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:28.059536 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:28.060311 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:28.060874 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:28.181851 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:28.190858 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c6e59886-7797-4ed9-aa95-1aab4f5ffb28 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1317 microversion: 2.1 time: 0.159415 Aug 07 19:34:28.191703 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 471/928] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:28 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:29.226308 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:29.234086 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:29.289769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:29.293274 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:29.299109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:29.311561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:29.315106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:29.323135 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:29.516520 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:29.537588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fb15b728-1181-4429-9346-d233f3f44125 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1317 microversion: 2.1 time: 0.326121 Aug 07 19:34:29.540920 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 458/929] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:29 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:30.575309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:30.579767 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:30.618001 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:30.622571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:30.626941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:30.630891 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:30.632412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:30.634507 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:31.079618 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:31.094581 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-710f6cb0-cf85-47fe-9d3c-9d7be46dd6ea tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.534885 Aug 07 19:34:31.097950 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 472/930] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:30 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:31.437154 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1eafdee9-07fd-426e-bd4c-436eea0d9d34 req-7e4f99f7-904c-4e64-881a-fe7d228dc413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf", "tag": "5c84fb20-a272-4feb-a394-fcc1548d2028"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:31.472261 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1eafdee9-07fd-426e-bd4c-436eea0d9d34 req-7e4f99f7-904c-4e64-881a-fe7d228dc413 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:31.473145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1eafdee9-07fd-426e-bd4c-436eea0d9d34 req-7e4f99f7-904c-4e64-881a-fe7d228dc413 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:31.480408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1eafdee9-07fd-426e-bd4c-436eea0d9d34 req-7e4f99f7-904c-4e64-881a-fe7d228dc413 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:31.536494 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1eafdee9-07fd-426e-bd4c-436eea0d9d34 req-7e4f99f7-904c-4e64-881a-fe7d228dc413 service nova] Creating event network-changed:5c84fb20-a272-4feb-a394-fcc1548d2028 for instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf on hv-cinder-85032 Aug 07 19:34:31.557585 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1eafdee9-07fd-426e-bd4c-436eea0d9d34 req-7e4f99f7-904c-4e64-881a-fe7d228dc413 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122394 Aug 07 19:34:31.559814 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 459/931] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:32.127087 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:32.131193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:32.163126 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:32.164398 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:32.167210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:32.174634 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:32.177785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:32.182560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:32.706970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:32.718310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:32.736246 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b41d0ace-9167-4f0c-8dcf-c27ef49094da tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.619549 Aug 07 19:34:32.738123 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 473/932] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:32 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:33.750964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-388bbdb9-b068-40d7-b719-ede4935bcfce req-3f681313-3aae-44de-bafc-6ba4b27675bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4a2ac8-fa21-4162-ad49-fab4967e05a6", "tag": "e06de1e9-007b-405d-8f0f-212607df278c"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:33.767674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:33.772656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:33.802412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-388bbdb9-b068-40d7-b719-ede4935bcfce req-3f681313-3aae-44de-bafc-6ba4b27675bc service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:33.803214 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-388bbdb9-b068-40d7-b719-ede4935bcfce req-3f681313-3aae-44de-bafc-6ba4b27675bc service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:33.803832 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-388bbdb9-b068-40d7-b719-ede4935bcfce req-3f681313-3aae-44de-bafc-6ba4b27675bc service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:33.805048 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:33.812703 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:33.813587 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:33.814365 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:33.815714 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:33.816599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:33.818936 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:33.836271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-388bbdb9-b068-40d7-b719-ede4935bcfce req-3f681313-3aae-44de-bafc-6ba4b27675bc service nova] Creating event network-changed:e06de1e9-007b-405d-8f0f-212607df278c for instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 on hv-cinder-85032 Aug 07 19:34:33.848771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-388bbdb9-b068-40d7-b719-ede4935bcfce req-3f681313-3aae-44de-bafc-6ba4b27675bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112766 Aug 07 19:34:33.851111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 460/933] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:34.132765 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:34.141847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a4728859-98e6-4058-b108-b187d657aae0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.384493 Aug 07 19:34:34.144083 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 474/934] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:33 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:35.180021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:35.180755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:35.183795 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:35.192091 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:35.192901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:35.193836 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:35.194762 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:35.195393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:35.196007 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:35.200013 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:35.394441 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:35.403952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ef2f8547-916c-4c39-adf2-d3f3183c565e tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.229188 Aug 07 19:34:35.404891 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 461/935] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:35 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:36.445626 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:36.446684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:36.451199 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:36.461455 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:36.462314 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:36.463071 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:36.464424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:36.465254 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:36.466027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:36.679650 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:36.695968 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-166e772c-b8fe-4dfd-8887-863969f60a26 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.258179 Aug 07 19:34:36.696981 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 475/936] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:36 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:37.721384 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:37.722961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:37.729002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:37.730172 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:37.733037 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:37.733864 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:37.734475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:37.735244 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:37.735701 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:37.736359 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:38.033136 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:38.047484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ed0798e0-1ff9-4c18-ab05-087889a8a18c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.331500 Aug 07 19:34:38.049003 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 462/937] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:37 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:39.070323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:39.070978 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:39.079210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:39.079780 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:39.080339 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:39.081402 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:39.081942 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:39.082380 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:39.266629 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:39.277416 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c527ebf0-9421-409b-b442-a31644c1d9ab tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.210605 Aug 07 19:34:39.278412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 476/938] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:39 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:40.305693 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:40.306542 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:40.318123 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:40.319002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:40.319712 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:40.321122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:40.322004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:40.322690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:40.524251 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:40.533946 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7085c00f-5830-4011-8c63-a2d637af03fa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.235714 Aug 07 19:34:40.534790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 463/939] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:40 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:41.560753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:41.561817 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:41.570368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:41.571032 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:41.571649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:41.572600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:41.573239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:41.573790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:41.756259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:41.770314 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-99a884b1-fab5-4862-87fb-1c7fd642e5a9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.214670 Aug 07 19:34:41.771235 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 477/940] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:41 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:42.791142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:42.791764 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:42.799184 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:42.799869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:42.800243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:42.800970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:42.801519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:42.801944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:42.985726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:42.994619 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-663c5cd9-f11b-4f77-b873-e70344301c36 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.207406 Aug 07 19:34:42.995228 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 464/941] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:42 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:43.458355 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9ac64d42-23ce-47ee-adbc-67d3d876ed38 req-9c7dd51f-1421-4fdd-bf2c-e3ab4b02b795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4a2ac8-fa21-4162-ad49-fab4967e05a6", "name": "network-vif-plugged", "status": "completed", "tag": "e06de1e9-007b-405d-8f0f-212607df278c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:43.474961 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ac64d42-23ce-47ee-adbc-67d3d876ed38 req-9c7dd51f-1421-4fdd-bf2c-e3ab4b02b795 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:43.475885 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ac64d42-23ce-47ee-adbc-67d3d876ed38 req-9c7dd51f-1421-4fdd-bf2c-e3ab4b02b795 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:43.476544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ac64d42-23ce-47ee-adbc-67d3d876ed38 req-9c7dd51f-1421-4fdd-bf2c-e3ab4b02b795 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:43.498791 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-9ac64d42-23ce-47ee-adbc-67d3d876ed38 req-9c7dd51f-1421-4fdd-bf2c-e3ab4b02b795 service nova] Creating event network-vif-plugged:e06de1e9-007b-405d-8f0f-212607df278c for instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 on hv-cinder-85032 Aug 07 19:34:43.508449 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9ac64d42-23ce-47ee-adbc-67d3d876ed38 req-9c7dd51f-1421-4fdd-bf2c-e3ab4b02b795 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056485 Aug 07 19:34:43.509410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 478/942] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:44.017940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:44.018947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:44.026344 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:44.026830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:44.027260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:44.027975 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:44.028454 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:44.028873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:44.180206 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:44.188364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b77c55ea-6833-4e29-b56e-c0a77d251b12 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.174557 Aug 07 19:34:44.188989 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 465/943] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:44 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:45.214768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:45.216112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:45.228704 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:45.229556 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:45.230294 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:45.231789 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:45.233227 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:45.234469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:45.448868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:45.459525 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f09bacf4-1d76-4b40-b64a-19d5e10f49c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1359 microversion: 2.1 time: 0.251622 Aug 07 19:34:45.460763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 479/944] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:45 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:46.485920 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:46.487315 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:46.498842 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:46.499695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:46.500548 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:46.501772 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:46.502633 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:46.503230 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:46.710339 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:46.722634 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8cd73cbf-7a9e-4ec5-bc86-c76e16e904ba tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1549 microversion: 2.1 time: 0.243445 Aug 07 19:34:46.723662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 466/945] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:46 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1549 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:46.749376 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:46.750334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:46.756659 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:46.757046 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:46.757483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:46.758235 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:46.758776 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:46.759236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:46.927217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:46.936474 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-56008014-a438-4ac6-9e25-8ad311effb29 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1549 microversion: 2.1 time: 0.192755 Aug 07 19:34:46.937063 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 480/946] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:46 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:34:46.960379 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:46.966277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:46.967098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Searching by: {'deleted': False, 'project_id': '1b16920c2e384c9ca20252917204b8ab'} {{(pid=117832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 19:34:46.974629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:46.975445 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:46.975882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:46.976686 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:46.977142 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:46.977564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:47.075712 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.multi_cell_list [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 19:34:47.178779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8620bbfe-dfa0-48d5-b78d-7c74ccab4cfa tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225355 Aug 07 19:34:47.184858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 467/947] 10.222.0.17 () {58 vars in 1125 bytes} [Sun Aug 7 19:34:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:47.192095 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:47.192736 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:47.199431 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:47.199924 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:47.200394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:47.201119 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:47.201568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:47.203106 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:47.372429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:47.381788 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3631de2f-446e-4e25-a808-a4be5c770ff3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1549 microversion: 2.1 time: 0.194455 Aug 07 19:34:47.382552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 481/948] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:47 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1549 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:34:49.116137 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fd0e04d-8d3f-410f-98cb-f618e82f0f6a"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:34:49.118501 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:49.125382 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:49.128023 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:49.128668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:49.129485 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:49.129981 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:49.130393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:49.433755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45782622-b937-4f35-bce6-be2dd1d9dbc1 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321825 Aug 07 19:34:49.434568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 468/949] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:34:49 2022] POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:34:59.335109 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=15 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:59.336656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=44 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:59.342665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:34:59.343559 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:34:59.351714 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:59.352422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:59.352904 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:59.353928 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:34:59.354450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:34:59.354936 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:34:59.543027 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:34:59.559043 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e13dbfaa-67a3-4996-af0f-52b85b658842 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1595 microversion: 2.1 time: 0.227802 Aug 07 19:34:59.560263 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 482/950] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:34:59 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1595 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:02.067308 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:02.068475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=15 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:02.068735 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:02.073626 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-5de31447-6df0-4da7-910f-7fe13d18ea8a req-664f8ae8-dd40-4651-960d-a41e123544a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4a2ac8-fa21-4162-ad49-fab4967e05a6", "tag": "e06de1e9-007b-405d-8f0f-212607df278c"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:35:02.085233 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5de31447-6df0-4da7-910f-7fe13d18ea8a req-664f8ae8-dd40-4651-960d-a41e123544a0 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:02.085713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5de31447-6df0-4da7-910f-7fe13d18ea8a req-664f8ae8-dd40-4651-960d-a41e123544a0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:02.086143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5de31447-6df0-4da7-910f-7fe13d18ea8a req-664f8ae8-dd40-4651-960d-a41e123544a0 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:02.102996 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-5de31447-6df0-4da7-910f-7fe13d18ea8a req-664f8ae8-dd40-4651-960d-a41e123544a0 service nova] Creating event network-changed:e06de1e9-007b-405d-8f0f-212607df278c for instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 on hv-cinder-85032 Aug 07 19:35:02.109023 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-5de31447-6df0-4da7-910f-7fe13d18ea8a req-664f8ae8-dd40-4651-960d-a41e123544a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043009 Aug 07 19:35:02.113628 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 469/951] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:35:03.900047 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-132896271"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:35:03.900745 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:03.907771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:03.908301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:03.908736 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:03.909643 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:03.910090 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:03.910508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:04.103329 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.network.security_group_api [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Adding security group 29d1d130-c5ea-4050-b333-6300c490774c to port e06de1e9-007b-405d-8f0f-212607df278c Aug 07 19:35:04.561785 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-406af8aa-abd4-44cb-aee7-4d641ca08ae4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/action" status: 202 len: 0 microversion: 2.1 time: 0.665721 Aug 07 19:35:04.566385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 483/952] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:35:03 2022] POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:35:04.579262 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:04.580162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-d6325c58-01a7-4646-94ad-95e46204f0d7 req-9455f866-d2a9-4c29-a0aa-0cd578d18533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4a2ac8-fa21-4162-ad49-fab4967e05a6", "tag": "e06de1e9-007b-405d-8f0f-212607df278c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:35:04.589343 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:04.602810 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:04.603166 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d6325c58-01a7-4646-94ad-95e46204f0d7 req-9455f866-d2a9-4c29-a0aa-0cd578d18533 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:04.604215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d6325c58-01a7-4646-94ad-95e46204f0d7 req-9455f866-d2a9-4c29-a0aa-0cd578d18533 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:04.605807 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:04.606643 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d6325c58-01a7-4646-94ad-95e46204f0d7 req-9455f866-d2a9-4c29-a0aa-0cd578d18533 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:04.608197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:04.609897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:04.611073 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:04.612364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:04.640161 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-d6325c58-01a7-4646-94ad-95e46204f0d7 req-9455f866-d2a9-4c29-a0aa-0cd578d18533 service nova] Creating event network-changed:e06de1e9-007b-405d-8f0f-212607df278c for instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 on hv-cinder-85032 Aug 07 19:35:04.657334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-d6325c58-01a7-4646-94ad-95e46204f0d7 req-9455f866-d2a9-4c29-a0aa-0cd578d18533 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084061 Aug 07 19:35:04.659350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 484/953] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:35:04.878803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:04.889496 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-33f94b5a-a7c0-4f0e-a15d-6972dc3555c0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1760 microversion: 2.1 time: 0.319600 Aug 07 19:35:04.891167 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 470/954] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:04 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1760 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:19.904201 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:35:19.906823 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:19.909156 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:19.909790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=12 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:19.916478 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:19.916954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:19.917385 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:19.918092 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:19.918625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:19.920312 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:20.009692 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9629e4fd-6a10-449b-a7d1-5dc038dceeb6 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/action" status: 202 len: 0 microversion: 2.1 time: 0.109885 Aug 07 19:35:20.015184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 485/955] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:35:19 2022] POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:35:20.023112 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:20.024297 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:20.032263 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:20.032983 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:20.035447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:20.036464 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:20.037011 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:20.038556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:20.038804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:20.039597 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:20.228606 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:20.240513 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-20a66bb6-8d0e-487a-840d-409d77c9aa09 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1752 microversion: 2.1 time: 0.223208 Aug 07 19:35:20.241792 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 471/956] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:20 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:21.265589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:21.266617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:21.274692 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:21.275177 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:21.275637 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:21.276383 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:21.276868 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:21.277290 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:21.471324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:21.481025 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-19a607e4-a7a0-4f46-b910-1f76e651ec64 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.221201 Aug 07 19:35:21.481689 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 486/957] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:21 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:22.504874 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:22.505553 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:22.512940 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:22.513443 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:22.513881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:22.514622 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:22.515109 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:22.515537 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:22.684932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:22.694409 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-83201f1f-fc6d-4a57-857a-55e67b6523b3 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.193627 Aug 07 19:35:22.695067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 472/958] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:22 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:23.725837 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:23.726763 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:23.734004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:23.734504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:23.734941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:23.735648 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:23.736182 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:23.736676 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:23.966653 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:23.976804 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b6a41257-ce8b-443d-a7ad-017014a12414 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.254768 Aug 07 19:35:23.977292 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 487/959] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:23 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:25.003236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:25.004185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:25.014028 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:25.014730 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:25.016398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:25.018041 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:25.018843 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:25.019792 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:25.210231 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:25.219362 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c07f5ff5-09b5-4c35-81e2-53b9043bfce4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.222785 Aug 07 19:35:25.219966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 473/960] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:24 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:26.259738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:26.260951 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:26.270284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:26.270771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:26.271195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:26.271950 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:26.272430 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:26.272850 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:26.458128 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:26.473053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-962b2d0f-7399-4480-8a2d-4e908a18a3d2 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.220545 Aug 07 19:35:26.474049 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 488/961] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:26 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:27.499515 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:27.500553 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:27.509037 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:27.509717 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:27.510252 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:27.511104 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:27.511740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:27.512319 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:27.721239 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:27.731175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-50328624-0451-49d2-b2f8-fa98b8244bb0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.237246 Aug 07 19:35:27.731823 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 474/962] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:27 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:28.760258 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:28.761353 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:28.772964 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:28.773806 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:28.774576 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:28.775777 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:28.776603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:28.777341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:28.987271 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:28.998636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7d2aac0c-1543-452d-a81e-2e57ea055422 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.245322 Aug 07 19:35:28.999236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 489/963] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:28 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:30.035947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:30.036859 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:30.046721 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:30.047659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:30.048615 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:30.049659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:30.050324 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:30.051039 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:30.274317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:30.285499 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3ffc4962-1a41-4292-be0c-006ada0d83b4 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.254795 Aug 07 19:35:30.286551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 475/964] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:30 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:31.311762 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:31.312748 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:31.322923 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:31.323612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:31.324266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:31.325295 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:31.325935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:31.326534 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:31.569946 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:31.579591 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f72d38f-b442-46c3-85b4-4e9c85ec2770 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.273714 Aug 07 19:35:31.580492 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 490/965] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:31 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:32.613098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:32.615067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:32.625021 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:32.625931 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:32.626786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:32.627914 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:32.628699 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:32.629473 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:32.878374 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:32.896148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3bc79357-8a68-462f-a24b-49f3082f9ee5 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.288650 Aug 07 19:35:32.897755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 476/966] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:32 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:35:33.928695 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:33.929831 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:33.939829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:33.940717 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:33.941453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:33.942658 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:33.943491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:33.944257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:34.148971 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:34.159512 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dbd34946-d054-433a-a976-089010f6a93d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.237724 Aug 07 19:35:34.160356 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 491/967] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:33 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:34.440521 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-710085162", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "networks": [{"uuid": "80da46e4-70fd-42ba-aadc-565ec0b4e56e"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:35:34.508374 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] validate_networks() for [('80da46e4-70fd-42ba-aadc-565ec0b4e56e', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:35:34.956309 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:35:34.956783 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:35:34.957422 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:35:34.957904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:35:34.958431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:35:34.974873 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:34.975428 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:34.976121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:34.977239 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:34.977941 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:34.978491 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:35.002071 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Getting quotas for project af90b9767e934addbde86fbe26c72c0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:35:35.009578 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Getting quotas for user d8077e19cce64faab6e5d71e3e56880d and project af90b9767e934addbde86fbe26c72c0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:35:35.032128 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:35:35.036689 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:35:35.115478 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3dfb5e65-473d-498c-af05-b5d72794f05f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678857 Aug 07 19:35:35.116348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 477/968] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:35:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:35:35.128453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe32333a-aa13-4560-94e6-e5a3486bb58c tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:35.129098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe32333a-aa13-4560-94e6-e5a3486bb58c tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:35.185130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:35.186144 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:35.195962 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:35.195962 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:35.196653 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:35.197645 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:35.198285 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:35.198833 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:35.199420 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe32333a-aa13-4560-94e6-e5a3486bb58c tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:35.207116 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe32333a-aa13-4560-94e6-e5a3486bb58c tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1218 microversion: 2.1 time: 0.082469 Aug 07 19:35:35.207732 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 492/969] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:35 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:35.410581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:35.420356 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c42e6e9e-ef0d-4424-882f-4586d44a843b tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.240969 Aug 07 19:35:35.420951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 478/970] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:35 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:35:36.231937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:36.233061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:36.242717 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:36.243467 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:36.244315 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:36.245707 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:36.246713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:36.247560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:36.350926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:36.360259 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-388cee7c-bb6f-4143-b448-606a3daf5e1e tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1270 microversion: 2.1 time: 0.132531 Aug 07 19:35:36.361200 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 493/971] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:36 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1270 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:36.445341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:36.446412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:36.455751 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:36.456490 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:36.457260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:36.458270 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:36.458895 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:36.459545 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:36.698803 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:36.713776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f5e21f20-6a5a-4d58-adcd-4ba5b0771872 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1757 microversion: 2.1 time: 0.274176 Aug 07 19:35:36.714829 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 479/972] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:36 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1757 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:37.388890 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:37.390145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:37.400181 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:37.401036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:37.401681 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:37.402869 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:37.403683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:37.404403 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:37.648617 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:37.659631 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7cb91147-0684-4654-911e-2b703ae4fe6a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1318 microversion: 2.1 time: 0.277756 Aug 07 19:35:37.660500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 494/973] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:37 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:37.747951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:37.748825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:37.756022 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:37.756853 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:37.757276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:37.758044 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:37.758546 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:37.759129 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:37.952851 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:37.961824 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-701214fc-4ea3-40d3-90d2-9e5fd658e158 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1760 microversion: 2.1 time: 0.218176 Aug 07 19:35:37.962389 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 480/974] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:37 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1760 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:38.339598 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-dd835bc9-0d66-4cdb-b180-536ce442650a req-74d879ad-6995-42d3-bb1f-982a04aab96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe66fd48-aa6e-453f-82d4-d2aef4b142ed", "tag": "5ac7e7f1-1254-4ee4-a357-0173afa18ede"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:35:38.359593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dd835bc9-0d66-4cdb-b180-536ce442650a req-74d879ad-6995-42d3-bb1f-982a04aab96c service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:38.360590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dd835bc9-0d66-4cdb-b180-536ce442650a req-74d879ad-6995-42d3-bb1f-982a04aab96c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:38.361435 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dd835bc9-0d66-4cdb-b180-536ce442650a req-74d879ad-6995-42d3-bb1f-982a04aab96c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:38.383202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-dd835bc9-0d66-4cdb-b180-536ce442650a req-74d879ad-6995-42d3-bb1f-982a04aab96c service nova] Creating event network-changed:5ac7e7f1-1254-4ee4-a357-0173afa18ede for instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed on hv-cinder-85032 Aug 07 19:35:38.392113 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-dd835bc9-0d66-4cdb-b180-536ce442650a req-74d879ad-6995-42d3-bb1f-982a04aab96c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056791 Aug 07 19:35:38.393257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 495/975] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:35:38.686644 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:38.687646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:38.701135 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:38.701863 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:38.702834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:38.704084 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:38.705000 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:38.705900 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:38.891220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:38.899742 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-17fdffba-9f9d-4710-ae37-56a76ba89f81 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1318 microversion: 2.1 time: 0.220315 Aug 07 19:35:38.900412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 481/976] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:38 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:39.923256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:39.924400 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:39.931753 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:39.932297 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:39.932740 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:39.933493 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:39.933972 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:39.934490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:40.359831 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:40.368589 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2cddd731-330f-48f8-802b-171549f68790 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1318 microversion: 2.1 time: 0.450474 Aug 07 19:35:40.369186 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 496/977] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:39 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:41.393973 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:41.394977 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:41.405936 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:41.406809 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:41.407492 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:41.408650 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:41.409446 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:41.410093 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:41.568944 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:41.578161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fd8b6851-2c8b-45b4-b92d-820d3bfbf4e6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1318 microversion: 2.1 time: 0.191629 Aug 07 19:35:41.578778 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 482/978] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:41 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:42.600826 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:42.601541 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:42.609207 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:42.609704 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:42.610141 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:42.610866 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:42.611323 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:42.611751 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:42.758498 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:42.766848 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0937edce-8688-40eb-b13c-b218d5a841dd tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1318 microversion: 2.1 time: 0.170063 Aug 07 19:35:42.767442 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 497/979] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:42 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:43.792911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:43.794357 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:43.808033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:43.808904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:43.809625 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:43.810867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:43.812043 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:43.812861 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:43.813508 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ac0cd23c-cc68-4f7e-b55f-5b2441c0a854 req-8c45dfd8-7e09-4b47-b34a-b11bf90bb84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe66fd48-aa6e-453f-82d4-d2aef4b142ed", "name": "network-vif-plugged", "status": "completed", "tag": "5ac7e7f1-1254-4ee4-a357-0173afa18ede"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:35:43.831900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ac0cd23c-cc68-4f7e-b55f-5b2441c0a854 req-8c45dfd8-7e09-4b47-b34a-b11bf90bb84f service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:43.833007 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ac0cd23c-cc68-4f7e-b55f-5b2441c0a854 req-8c45dfd8-7e09-4b47-b34a-b11bf90bb84f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:43.833947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ac0cd23c-cc68-4f7e-b55f-5b2441c0a854 req-8c45dfd8-7e09-4b47-b34a-b11bf90bb84f service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:43.856776 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ac0cd23c-cc68-4f7e-b55f-5b2441c0a854 req-8c45dfd8-7e09-4b47-b34a-b11bf90bb84f service nova] Creating event network-vif-plugged:5ac7e7f1-1254-4ee4-a357-0173afa18ede for instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed on hv-cinder-85032 Aug 07 19:35:43.866399 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ac0cd23c-cc68-4f7e-b55f-5b2441c0a854 req-8c45dfd8-7e09-4b47-b34a-b11bf90bb84f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060109 Aug 07 19:35:43.867675 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 498/980] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:35:44.019153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:44.031943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5cf2203b-3da5-4f05-bf24-5139056f85f9 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1318 microversion: 2.1 time: 0.246210 Aug 07 19:35:44.032947 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 483/981] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:43 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:45.055817 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:45.056889 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:45.064325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:45.064930 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:45.065484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:45.066299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:45.066842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:45.067343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:45.204671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:45.260191 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:45.268729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6439fa20-f9fb-499b-8022-5945ba3eafdb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1318 microversion: 2.1 time: 0.217781 Aug 07 19:35:45.269211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 499/982] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:45 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:35:46.293755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:35:46.295091 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:35:46.298955 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:46.300111 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:46.310629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:46.311461 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:46.312147 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:46.313282 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:35:46.314046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:35:46.314786 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:35:46.493765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:35:46.502164 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-97f56557-86fb-4555-bd14-bf283e578da2 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1508 microversion: 2.1 time: 0.215126 Aug 07 19:35:46.502846 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 484/983] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:35:46 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:00.895021 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2424012e-d9df-48ad-93a6-dea7e9d29d33", "device": "/dev/sdb"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:00.898069 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:00.900503 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=32 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:00.901247 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:00.907600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:00.908120 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:00.908625 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:00.909351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:00.909801 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:00.910222 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:01.417061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-55f7d0a8-6e6f-46d1-af3f-cda8ce04d117 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "POST /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526823 Aug 07 19:36:01.417694 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 500/984] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:36:00 2022] POST /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:15.638054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-132896271"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:15.639098 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:15.641844 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:15.643886 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=80 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:15.651612 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:15.652344 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:15.652807 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:15.653559 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:15.654051 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:15.654558 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:15.936078 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.network.security_group_api [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Removing security group 29d1d130-c5ea-4050-b333-6300c490774c from port e06de1e9-007b-405d-8f0f-212607df278c Aug 07 19:36:16.360032 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3c707eff-a4ba-404c-9e25-7d81f25daca9 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/action" status: 202 len: 0 microversion: 2.1 time: 0.726725 Aug 07 19:36:16.360925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 485/985] 10.222.0.17 () {60 vars in 1278 bytes} [Sun Aug 7 19:36:15 2022] POST /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:36:16.367256 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:16.368037 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:16.373932 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-8b74fd34-b031-49a0-a23f-87175556466d req-5f00ef42-2b4c-4d44-8b97-2c25c740db6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4a2ac8-fa21-4162-ad49-fab4967e05a6", "tag": "e06de1e9-007b-405d-8f0f-212607df278c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:16.390838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8b74fd34-b031-49a0-a23f-87175556466d req-5f00ef42-2b4c-4d44-8b97-2c25c740db6e service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:16.391624 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8b74fd34-b031-49a0-a23f-87175556466d req-5f00ef42-2b4c-4d44-8b97-2c25c740db6e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:16.392315 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8b74fd34-b031-49a0-a23f-87175556466d req-5f00ef42-2b4c-4d44-8b97-2c25c740db6e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:16.413297 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-8b74fd34-b031-49a0-a23f-87175556466d req-5f00ef42-2b4c-4d44-8b97-2c25c740db6e service nova] Creating event network-changed:e06de1e9-007b-405d-8f0f-212607df278c for instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 on hv-cinder-85032 Aug 07 19:36:16.419405 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-8b74fd34-b031-49a0-a23f-87175556466d req-5f00ef42-2b4c-4d44-8b97-2c25c740db6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053027 Aug 07 19:36:16.420214 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 501/986] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:17.560355 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:17.561004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:17.567339 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:17.567826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:17.568299 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:17.569010 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:17.569483 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:17.569904 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:17.668607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lazy-loading 'services' on Instance uuid 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:36:17.759939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0b56ac77-c44f-4c86-ad67-2900575d42a8 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments/7fd0e04d-8d3f-410f-98cb-f618e82f0f6a" status: 202 len: 0 microversion: 2.1 time: 0.206198 Aug 07 19:36:17.760584 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 486/987] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:36:17 2022] DELETE /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments/7fd0e04d-8d3f-410f-98cb-f618e82f0f6a => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:36:17.770875 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:17.773527 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:17.781138 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:17.781635 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:17.782070 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:17.782810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:17.783268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:17.783780 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:17.820842 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-82257e2d-14e3-44e3-af58-b3dfddb88973 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054911 Aug 07 19:36:17.821458 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 502/988] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:36:17 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:17.855607 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:36:17.855943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Sun Aug 7 19:36:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:36:18.440966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c64331d1-f0f6-48d0-b8d7-724079f8b502 req-b2445c3f-9509-4e9c-9cfb-52b9a949b2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4a2ac8-fa21-4162-ad49-fab4967e05a6", "tag": "e06de1e9-007b-405d-8f0f-212607df278c"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:18.455612 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c64331d1-f0f6-48d0-b8d7-724079f8b502 req-b2445c3f-9509-4e9c-9cfb-52b9a949b2d3 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:18.456274 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c64331d1-f0f6-48d0-b8d7-724079f8b502 req-b2445c3f-9509-4e9c-9cfb-52b9a949b2d3 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:18.456813 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c64331d1-f0f6-48d0-b8d7-724079f8b502 req-b2445c3f-9509-4e9c-9cfb-52b9a949b2d3 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:18.472876 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c64331d1-f0f6-48d0-b8d7-724079f8b502 req-b2445c3f-9509-4e9c-9cfb-52b9a949b2d3 service nova] Creating event network-changed:e06de1e9-007b-405d-8f0f-212607df278c for instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 on hv-cinder-85032 Aug 07 19:36:18.480551 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c64331d1-f0f6-48d0-b8d7-724079f8b502 req-b2445c3f-9509-4e9c-9cfb-52b9a949b2d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046086 Aug 07 19:36:18.481416 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 487/989] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:18.855481 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:18.871736 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:18.894193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:18.897529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:18.897529 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:18.898148 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:18.899389 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:18.899558 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:18.976710 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-57570fbc-dd4e-4c82-af5c-93eef17ac512 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143164 Aug 07 19:36:18.977920 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 503/990] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:36:18 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:19.993323 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:19.996156 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:20.003117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:20.003610 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:20.004539 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:20.005304 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:20.005775 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:20.006209 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:20.043268 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5933f7c2-bbfb-461d-89de-ddf43243f223 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054918 Aug 07 19:36:20.044526 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 488/991] 10.222.0.17 () {58 vars in 1302 bytes} [Sun Aug 7 19:36:19 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 19:36:20.059885 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:20.060522 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:20.067686 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:20.068237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:20.068671 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:20.069386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:20.069838 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:20.070257 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:20.158184 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] HTTP exception thrown: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 is not attached to volume 7fd0e04d-8d3f-410f-98cb-f618e82f0f6a Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Request method failure captured: Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments/7fd0e04d-8d3f-410f-98cb-f618e82f0f6a HTTP/1.1 Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BOoetqfFcHGEER5AA-ftUz2Lbbr7QgrKYZWwotvGQwwr-UBm_PEW7nrlMDEKv79Jv6sZ0tejMPavJ4Y0Jwjrt9S8GT0Cb-eTr3--nqXNfF24OAAkCkseTpj-zFwxLC7XL3PpS8ZAgiQnWDSe58hcdPTjjEZheePs1gQUi9HcrRs3zE Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 1b16920c2e384c9ca20252917204b8ab Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestMinimumBasicScenario-847354819 Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:36:20.160925 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b16920c2e384c9ca20252917204b8ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1b16920c2e384c9ca20252917204b8ab", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1b16920c2e384c9ca20252917204b8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b16920c2e384c9ca20252917204b8ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestMinimumBasicScenario-847354819 Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 1b16920c2e384c9ca20252917204b8ab Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestMinimumBasicScenario-847354819 Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-TestMinimumBasicScenario-847354819-project Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 523936e9a8ca49b9805fa110a1841d64 Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestMinimumBasicScenario-847354819-project Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:36:20.164230 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 is not attached to volume 7fd0e04d-8d3f-410f-98cb-f618e82f0f6a Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '9a4a2ac8-fa21-4162-ad49-fab4967e05a6', 'id': '7fd0e04d-8d3f-410f-98cb-f618e82f0f6a'} Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7fd0e04d-8d3f-410f-98cb-f618e82f0f6a. Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:36:20.165807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 is not attached to volume 7fd0e04d-8d3f-410f-98cb-f618e82f0f6a Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 is not attached to volume 7fd0e04d-8d3f-410f-98cb-f618e82f0f6a Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:20.168357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Returning 404 to user: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 is not attached to volume 7fd0e04d-8d3f-410f-98cb-f618e82f0f6a {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:36:20.170883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9cb82815-03b0-47df-b868-99296be9fef0 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments/7fd0e04d-8d3f-410f-98cb-f618e82f0f6a" status: 404 len: 154 microversion: 2.1 time: 0.107399 Aug 07 19:36:20.170883 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 504/992] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:36:20 2022] DELETE /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6/os-volume_attachments/7fd0e04d-8d3f-410f-98cb-f618e82f0f6a => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:21.332198 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:21.332882 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:21.339723 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:21.340367 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:21.340696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:21.341393 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:21.341870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:21.342277 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:21.369459 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:36:21.460743 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fa077efd-4536-4108-b816-5b15b4d0ddbe tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 204 len: 0 microversion: 2.1 time: 0.132408 Aug 07 19:36:21.461600 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 489/993] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:36:21 2022] DELETE /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:36:21.473061 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:21.473977 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:21.481637 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:21.482131 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:21.482562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:21.483314 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:21.483766 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:21.484217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:21.638642 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:21.647340 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7c6b0a54-f297-4f16-bab0-5a044967b827 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1555 microversion: 2.1 time: 0.179499 Aug 07 19:36:21.647948 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 505/994] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:21 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:21.980525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:21.981114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:21.987542 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:21.988046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:21.988486 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:21.989189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:21.989640 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:21.990062 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:22.023512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:36:22.122519 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ebb73af7-ba0d-46a1-87da-0dec397f451a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 204 len: 0 microversion: 2.1 time: 0.146060 Aug 07 19:36:22.123117 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 490/995] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:36:21 2022] DELETE /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:36:22.133655 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:22.134264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:22.140795 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:22.141325 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:22.141756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:22.142466 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:22.142991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:22.143419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:22.286360 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:22.294775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-af61e71b-3879-47bd-8ced-e82a0c6abd1d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1577 microversion: 2.1 time: 0.167140 Aug 07 19:36:22.295364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 506/996] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:22 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:22.568047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:22.568672 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:22.576461 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:22.577134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:22.577707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:22.578817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:22.579646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:22.580290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:22.673274 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:22.674777 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:22.684600 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:22.685518 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:22.685690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:22.686566 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:22.687108 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:22.687590 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:22.694318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lazy-loading 'services' on Instance uuid fe66fd48-aa6e-453f-82d4-d2aef4b142ed {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:36:22.797055 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a607fd65-3a49-4d53-b23b-db11ac6969c6 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed/os-volume_attachments/2424012e-d9df-48ad-93a6-dea7e9d29d33" status: 202 len: 0 microversion: 2.1 time: 0.233455 Aug 07 19:36:22.800028 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 491/997] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:36:22 2022] DELETE /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed/os-volume_attachments/2424012e-d9df-48ad-93a6-dea7e9d29d33 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:36:22.868341 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:22.883535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a18fd198-dc73-4d5f-9725-1976c91a887d tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1555 microversion: 2.1 time: 0.217111 Aug 07 19:36:22.884150 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 507/998] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:22 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:23.317611 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:23.318345 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:23.325842 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:23.326377 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:23.326869 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:23.327665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:23.328170 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:23.328609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:23.471962 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:23.480253 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c758cac5-0a09-42d1-925a-b445ea7e76cb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1577 microversion: 2.1 time: 0.167579 Aug 07 19:36:23.480849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 492/999] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:23 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:23.904993 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:23.905607 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:23.912361 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:23.912857 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:23.913284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:23.914024 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:23.914471 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:23.914897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:24.053759 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:24.065660 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2562b8a7-4aba-4844-896b-aef1a80698fb tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1555 microversion: 2.1 time: 0.164615 Aug 07 19:36:24.066207 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 508/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:23 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:24.505710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:24.506871 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:24.517901 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:24.518750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:24.519510 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:24.520805 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:24.521612 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:24.522367 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:24.687576 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:24.696366 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-63d49410-3ff0-49ad-b98e-bab0cb89cf60 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1577 microversion: 2.1 time: 0.197941 Aug 07 19:36:24.696892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 493/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:24 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:25.087370 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:25.088107 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:25.095112 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:25.095601 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:25.096036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:25.096811 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:25.097234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:25.097657 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:25.250829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:25.259166 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fa2637bc-a0a5-42f7-8986-73d32bad1590 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1555 microversion: 2.1 time: 0.175856 Aug 07 19:36:25.259957 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 509/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:25 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:25.723346 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:25.725578 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:25.734493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:25.734972 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:25.735435 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:25.736175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:25.736648 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:25.737084 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:25.936143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:25.952755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0840e70c-90de-4640-8efe-3de6474e124b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1577 microversion: 2.1 time: 0.236464 Aug 07 19:36:25.953855 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 494/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:25 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:25.981357 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-dda01124-5ae5-4b14-97d8-1be695ca8e08 req-85432fae-3817-45f4-a34c-ae4a72cae912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4a2ac8-fa21-4162-ad49-fab4967e05a6", "name": "network-vif-deleted", "tag": "e06de1e9-007b-405d-8f0f-212607df278c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:26.004926 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dda01124-5ae5-4b14-97d8-1be695ca8e08 req-85432fae-3817-45f4-a34c-ae4a72cae912 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.006488 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dda01124-5ae5-4b14-97d8-1be695ca8e08 req-85432fae-3817-45f4-a34c-ae4a72cae912 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.014132 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dda01124-5ae5-4b14-97d8-1be695ca8e08 req-85432fae-3817-45f4-a34c-ae4a72cae912 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.034009 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-dda01124-5ae5-4b14-97d8-1be695ca8e08 req-85432fae-3817-45f4-a34c-ae4a72cae912 service nova] Creating event network-vif-deleted:e06de1e9-007b-405d-8f0f-212607df278c for instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 on hv-cinder-85032 Aug 07 19:36:26.040332 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-dda01124-5ae5-4b14-97d8-1be695ca8e08 req-85432fae-3817-45f4-a34c-ae4a72cae912 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067536 Aug 07 19:36:26.041367 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 510/1004] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:36:26.101523 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:26.102468 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:26.112647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.114335 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.114892 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.115733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.116237 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.116762 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.163825 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:36:26.257508 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4611297e-f884-4739-af62-7704f1a14ccb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 204 len: 0 microversion: 2.1 time: 0.160029 Aug 07 19:36:26.258173 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 495/1005] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:36:26 2022] DELETE /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:36:26.267664 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:26.268801 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:26.276778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.277551 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.278810 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.279834 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.280499 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.281081 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.281287 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:26.282001 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:26.290061 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.290598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.291038 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.291807 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.292306 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.292733 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.299260 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=5,nova_cell1:UPDATE=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:26.344815 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.345659 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.346605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.347607 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lazy-loading 'fault' on Instance uuid 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:36:26.416915 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:26.437818 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1c0f1c77-236a-4c79-a1aa-ad37c3c1c576 tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1349 microversion: 2.1 time: 0.160711 Aug 07 19:36:26.443525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 496/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:26 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1349 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:36:26.509333 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:26.524282 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f79029d-15d1-4c92-9d78-c7c85b452b02 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1514 microversion: 2.1 time: 0.260411 Aug 07 19:36:26.526042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 511/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:26 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:26.975231 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:26.975857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:26.982700 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.983197 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.983634 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:26.984591 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:26.985053 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:26.985475 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:27.075507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:27.084398 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3a3076eb-5585-4004-a7ca-ad0b5a077553 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1510 microversion: 2.1 time: 0.113133 Aug 07 19:36:27.085144 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 497/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:26 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1510 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:27.466349 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:27.467309 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:27.478705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:27.479386 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:27.480201 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:27.481473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:27.482284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:27.483057 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:27.543683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:27.544954 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:27.545754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:27.546582 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lazy-loading 'fault' on Instance uuid 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:36:27.546832 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:27.547467 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:27.554083 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:27.554588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:27.555032 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:27.555766 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:27.556265 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:27.556694 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:27.612750 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523936e9a8ca49b9805fa110a1841d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16920c2e384c9ca20252917204b8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:27.624078 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f49aa17-2ce6-422b-b3b5-366796381f3c tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 200 len: 1349 microversion: 2.1 time: 0.162636 Aug 07 19:36:27.624713 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 512/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:27 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 1349 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:27.722775 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:27.734706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ec7a5c2e-729b-4094-9b37-eaf3a664d48a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1514 microversion: 2.1 time: 0.192055 Aug 07 19:36:27.735301 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 498/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:27 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:28.058284 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-6b6d7299-1cf7-4ca3-a3f8-d88d9622ac64 req-d7384399-4550-4bd9-b993-2b62b46cd8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf", "name": "network-vif-deleted", "tag": "5c84fb20-a272-4feb-a394-fcc1548d2028"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:28.070211 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6b6d7299-1cf7-4ca3-a3f8-d88d9622ac64 req-d7384399-4550-4bd9-b993-2b62b46cd8c1 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:28.070698 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6b6d7299-1cf7-4ca3-a3f8-d88d9622ac64 req-d7384399-4550-4bd9-b993-2b62b46cd8c1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:28.071130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6b6d7299-1cf7-4ca3-a3f8-d88d9622ac64 req-d7384399-4550-4bd9-b993-2b62b46cd8c1 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:28.084291 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-6b6d7299-1cf7-4ca3-a3f8-d88d9622ac64 req-d7384399-4550-4bd9-b993-2b62b46cd8c1 service nova] Creating event network-vif-deleted:5c84fb20-a272-4feb-a394-fcc1548d2028 for instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf on hv-cinder-85032 Aug 07 19:36:28.089863 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-6b6d7299-1cf7-4ca3-a3f8-d88d9622ac64 req-d7384399-4550-4bd9-b993-2b62b46cd8c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035665 Aug 07 19:36:28.090513 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 513/1011] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:28.110264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:28.112412 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:28.123631 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:28.124804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:28.125522 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:28.126726 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:28.127378 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:28.127966 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:28.212503 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:28.227911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2bdad3b4-3716-46e1-80e2-2d2e463277d3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 200 len: 1225 microversion: 2.1 time: 0.123073 Aug 07 19:36:28.228978 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 499/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:28 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:28.652172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:28.656807 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] [instance: 9a4a2ac8-fa21-4162-ad49-fab4967e05a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:28.669132 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:28.669644 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:28.670094 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:28.670822 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:28.671303 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:28.671729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:28.687764 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] HTTP exception thrown: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 could not be found. Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Request method failure captured: Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 HTTP/1.1 Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BOoetqfFcHGEER5AA-ftUz2Lbbr7QgrKYZWwotvGQwwr-UBm_PEW7nrlMDEKv79Jv6sZ0tejMPavJ4Y0Jwjrt9S8GT0Cb-eTr3--nqXNfF24OAAkCkseTpj-zFwxLC7XL3PpS8ZAgiQnWDSe58hcdPTjjEZheePs1gQUi9HcrRs3zE Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: 1b16920c2e384c9ca20252917204b8ab Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestMinimumBasicScenario-847354819 Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:36:28.689991 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b16920c2e384c9ca20252917204b8ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1b16920c2e384c9ca20252917204b8ab", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1b16920c2e384c9ca20252917204b8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1b16920c2e384c9ca20252917204b8ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestMinimumBasicScenario-847354819 Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 1b16920c2e384c9ca20252917204b8ab Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestMinimumBasicScenario-847354819 Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-TestMinimumBasicScenario-847354819-project Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 523936e9a8ca49b9805fa110a1841d64 Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestMinimumBasicScenario-847354819-project Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 could not be found. Aug 07 19:36:28.691490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '9a4a2ac8-fa21-4162-ad49-fab4967e05a6'} Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 could not be found. Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:36:28.692378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 could not be found. Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 could not be found. Aug 07 19:36:28.693654 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:36:28.697606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Returning 404 to user: Instance 9a4a2ac8-fa21-4162-ad49-fab4967e05a6 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:36:28.697606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-996d344a-167b-4ed6-ad94-fb7ed536721a tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6" status: 404 len: 111 microversion: 2.1 time: 0.048858 Aug 07 19:36:28.697606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 514/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:28 2022] GET /compute/v2.1/servers/9a4a2ac8-fa21-4162-ad49-fab4967e05a6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:28.706477 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-68b94d67-87d9-469d-8397-51135d32ddff tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] Calling method '.version_select at 0x7fd47c10c820>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:28.758145 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:28.758775 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:28.770030 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:28.770514 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:28.771185 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:28.772164 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:28.772622 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:28.777172 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:28.777647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-68b94d67-87d9-469d-8397-51135d32ddff tempest-TestMinimumBasicScenario-847354819 tempest-TestMinimumBasicScenario-847354819-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1205919276" status: 202 len: 0 microversion: 2.1 time: 0.076887 Aug 07 19:36:28.779243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 500/1014] 10.222.0.17 () {58 vars in 1272 bytes} [Sun Aug 7 19:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1205919276 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:36:28.896750 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:28.905829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0da0b49f-3bd0-4e20-a3f5-fe3f5ccce4d0 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 200 len: 1472 microversion: 2.1 time: 0.151611 Aug 07 19:36:28.908034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 515/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:28 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:29.259598 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:29.260995 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:29.269935 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:29.270452 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:29.271350 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:29.271773 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:29.272334 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:29.272964 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:29.295629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] HTTP exception thrown: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Request method failure captured: Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf HTTP/1.1 Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BOMR57ykhhFharEKQp2Y3k8meWAqjHrwSfzs9sTTlySe0kPiZfU6elvxWE9M9y-OkCjIfuUe_pxo8VlfU_PGvpRvDzNE2QTAMPlawtgZbML05EUEklBu9mhoeIDnyAFUrHjKYJwBpfh5ZvMAFEhVu7r4h-303oldK4p3w4eb19uLAg Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:36:29.298201 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bdc0726934c64051b49ed81a2abc5c89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-868506318 Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 656a586e718543bfb095790441c28fe8 Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:36:29.301348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf'} Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:36:29.303908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:36:29.307307 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:29.313857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Returning 404 to user: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:36:29.313857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-74dd08b5-8a92-4e7f-a789-ee16068f9815 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 404 len: 111 microversion: 2.1 time: 0.046632 Aug 07 19:36:29.313857 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 501/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:29 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:29.453445 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-553554021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1892901741", "security_groups": [{"name": "tempest-secgroup-smoke-501637307"}], "block_device_mapping_v2": [{"uuid": "981bdea0-358a-4e37-a9eb-79ef57645663", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2bbd619-d45a-4365-90a9-8061571047c4"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:29.593482 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] validate_networks() for [('c2bbd619-d45a-4365-90a9-8061571047c4', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:36:29.955808 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:29.956991 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: fe66fd48-aa6e-453f-82d4-d2aef4b142ed] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:29.968177 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:29.969049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:29.969840 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:29.973079 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:29.973858 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:29.974596 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:30.005668 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] HTTP exception thrown: Instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed could not be found. Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Request method failure captured: Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed HTTP/1.1 Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BQEicss4kWXACrWkO_SGMPtn4Saugj9GX0QwJ3gGua8p-J3W968ILPOctcMyDXvQUSiBFLWzX_nMhIwQOHHSIy3fSJk2xeBzf4KZsIipyecTljnfrcByjvDLPy6ItkEKP3-Ta20Z5H70rT6MUk_TJWpJke2MSXiimsrVdJhNz-2UWg Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: af90b9767e934addbde86fbe26c72c0a Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1336916753 Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:36:30.008961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af90b9767e934addbde86fbe26c72c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af90b9767e934addbde86fbe26c72c0a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af90b9767e934addbde86fbe26c72c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af90b9767e934addbde86fbe26c72c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotTestJSON-1336916753 Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: af90b9767e934addbde86fbe26c72c0a Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1336916753 Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotTestJSON-1336916753-project Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: d8077e19cce64faab6e5d71e3e56880d Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotTestJSON-1336916753-project Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed could not be found. Aug 07 19:36:30.010417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': 'fe66fd48-aa6e-453f-82d4-d2aef4b142ed'} Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed could not be found. Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:36:30.011303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed could not be found. Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed could not be found. Aug 07 19:36:30.012618 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:36:30.013750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Returning 404 to user: Instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:36:30.013750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7958128a-c049-4b72-9c70-1c3aa7632c5d tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed" status: 404 len: 111 microversion: 2.1 time: 0.063428 Aug 07 19:36:30.013750 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 502/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:29 2022] GET /compute/v2.1/servers/fe66fd48-aa6e-453f-82d4-d2aef4b142ed => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:30.110462 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-115f79f7-460f-4e24-adaf-9ff98aa1f2e8 req-764131ee-7063-4697-869d-e793f8faf802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe66fd48-aa6e-453f-82d4-d2aef4b142ed", "name": "network-vif-deleted", "tag": "5ac7e7f1-1254-4ee4-a357-0173afa18ede"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:30.124748 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-115f79f7-460f-4e24-adaf-9ff98aa1f2e8 req-764131ee-7063-4697-869d-e793f8faf802 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:30.125397 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-115f79f7-460f-4e24-adaf-9ff98aa1f2e8 req-764131ee-7063-4697-869d-e793f8faf802 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:30.125948 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-115f79f7-460f-4e24-adaf-9ff98aa1f2e8 req-764131ee-7063-4697-869d-e793f8faf802 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:30.144033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-115f79f7-460f-4e24-adaf-9ff98aa1f2e8 req-764131ee-7063-4697-869d-e793f8faf802 service nova] Creating event network-vif-deleted:5ac7e7f1-1254-4ee4-a357-0173afa18ede for instance fe66fd48-aa6e-453f-82d4-d2aef4b142ed on hv-cinder-85032 Aug 07 19:36:30.154056 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-115f79f7-460f-4e24-adaf-9ff98aa1f2e8 req-764131ee-7063-4697-869d-e793f8faf802 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049497 Aug 07 19:36:30.154912 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 503/1018] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:30.470217 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:36:30.471006 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:36:30.471844 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:36:30.472808 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:36:30.473606 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:36:30.490787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:30.492473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:30.493760 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:30.495431 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:30.496650 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:30.497490 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:30.527537 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for project bdc0726934c64051b49ed81a2abc5c89. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:36:30.534913 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for user 656a586e718543bfb095790441c28fe8 and project bdc0726934c64051b49ed81a2abc5c89. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:36:30.626115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:36:30.630517 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='981bdea0-358a-4e37-a9eb-79ef57645663',volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:36:30.832674 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-52308805-491a-43fd-a0aa-ded279fb13a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.383329 Aug 07 19:36:30.833561 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 516/1019] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:36:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:36:30.847002 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-19251c99-d3f6-4996-9679-1f473ad02b5c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:30.847925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-19251c99-d3f6-4996-9679-1f473ad02b5c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:30.960264 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-19251c99-d3f6-4996-9679-1f473ad02b5c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:30.968476 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-19251c99-d3f6-4996-9679-1f473ad02b5c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1094 microversion: 2.1 time: 0.127120 Aug 07 19:36:30.969349 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 504/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:30 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:31.995033 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:31.995846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:32.003286 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:32.003772 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:32.004459 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:32.005189 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:32.005665 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:32.015630 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:32.099562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:32.114931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-af78c051-768f-42ec-85aa-58f71c3b1f2d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1144 microversion: 2.1 time: 0.123433 Aug 07 19:36:32.116102 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 517/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:31 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1144 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:33.141856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:33.143023 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:33.159290 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:33.161283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:33.163760 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:33.165575 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:33.166771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:33.174417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:33.304435 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:33.312780 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a9fe4d8f-9c34-4832-a733-9848920dc652 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1136 microversion: 2.1 time: 0.179221 Aug 07 19:36:33.313497 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 505/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:33 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1136 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:34.337097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:34.338029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:34.348621 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:34.349571 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:34.350072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:34.351077 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:34.351632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:34.352334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:34.443679 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:34.466593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-04c44477-b955-44f8-814f-818b200d26c1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1210 microversion: 2.1 time: 0.133206 Aug 07 19:36:34.467695 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 518/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:34 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:36:35.500706 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:35.501563 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:35.509736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:35.510431 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:35.511144 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:35.512114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:35.512788 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:35.513442 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:35.764609 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:35.778033 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-544813e9-ed8c-4ffd-8146-50241129d07e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.281589 Aug 07 19:36:35.779030 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 506/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:35 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:36.151524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ee0b540a-94a3-42df-a52d-f1bffeaf14a9 req-c3c2a8a5-fc1c-48fd-97ea-ee93db27faaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "715746ed-7264-4abb-b2f8-e61e66eede32", "tag": "0c3fed4f-f5a6-4902-804b-a85c9ead5d85"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:36.169220 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ee0b540a-94a3-42df-a52d-f1bffeaf14a9 req-c3c2a8a5-fc1c-48fd-97ea-ee93db27faaa service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:36.169808 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ee0b540a-94a3-42df-a52d-f1bffeaf14a9 req-c3c2a8a5-fc1c-48fd-97ea-ee93db27faaa service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:36.171715 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ee0b540a-94a3-42df-a52d-f1bffeaf14a9 req-c3c2a8a5-fc1c-48fd-97ea-ee93db27faaa service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:36.190237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ee0b540a-94a3-42df-a52d-f1bffeaf14a9 req-c3c2a8a5-fc1c-48fd-97ea-ee93db27faaa service nova] Creating event network-changed:0c3fed4f-f5a6-4902-804b-a85c9ead5d85 for instance 715746ed-7264-4abb-b2f8-e61e66eede32 on hv-cinder-85032 Aug 07 19:36:36.195833 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ee0b540a-94a3-42df-a52d-f1bffeaf14a9 req-c3c2a8a5-fc1c-48fd-97ea-ee93db27faaa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050079 Aug 07 19:36:36.196523 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 519/1025] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:36.812716 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:36.814637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:36.826939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:36.828203 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:36.829008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:36.830298 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:36.831387 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:36.831919 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:37.024027 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:37.040261 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a2a705b3-1e3e-401b-8c1a-be5c472e52e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.230793 Aug 07 19:36:37.041771 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 507/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:36 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:38.064946 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:38.065676 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:38.073592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:38.074221 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:38.074846 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:38.075787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:38.076684 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:38.077306 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:38.335596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:38.343716 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-13026628", "imageRef": "e9ef92a5-d132-4bfc-b042-f617bc88607f", "flavorRef": "452", "networks": [{"uuid": "80da46e4-70fd-42ba-aadc-565ec0b4e56e"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:38.347450 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-180746f7-0e0e-452f-8df0-030aaaf4a858 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.285389 Aug 07 19:36:38.349091 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 520/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:38 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:38.407939 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] validate_networks() for [('80da46e4-70fd-42ba-aadc-565ec0b4e56e', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:36:39.227898 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:36:39.228590 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:36:39.229292 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:36:39.229716 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:36:39.233187 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:36:39.240034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:39.240533 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:39.240961 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:39.241908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:39.242358 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:39.242769 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:39.260380 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Getting quotas for project af90b9767e934addbde86fbe26c72c0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:36:39.264458 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Getting quotas for user d8077e19cce64faab6e5d71e3e56880d and project af90b9767e934addbde86fbe26c72c0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:36:39.277629 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:36:39.280054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9ef92a5-d132-4bfc-b042-f617bc88607f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:36:39.326581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-deb5d552-9e43-4a4c-8489-60cc998235b8 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987244 Aug 07 19:36:39.332153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 508/1028] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:36:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:36:39.339340 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-34b44c98-384b-460c-8345-03b47f158b16 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:39.340632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-34b44c98-384b-460c-8345-03b47f158b16 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:39.374363 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:39.375617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:39.385802 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:39.386322 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:39.386925 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:39.387807 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:39.388293 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:39.388721 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:39.406305 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-34b44c98-384b-460c-8345-03b47f158b16 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:39.414045 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-34b44c98-384b-460c-8345-03b47f158b16 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1217 microversion: 2.1 time: 0.079563 Aug 07 19:36:39.415253 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 521/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:39 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:39.568408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:39.582655 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-065a1bad-1f21-4874-98d1-200de2d999bb tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.214131 Aug 07 19:36:39.583752 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 509/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:39 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:36:40.440082 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:40.441491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:40.451825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:40.452793 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:40.453310 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:40.454756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:40.456063 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:40.456388 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:40.465011 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:40.508404 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:40.535208 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:40.543022 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4336559b-12d3-431a-83a4-57fb89b383ad tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1269 microversion: 2.1 time: 0.107093 Aug 07 19:36:40.545464 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 522/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:40 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:40.618067 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:40.619003 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:40.626506 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:40.627074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:40.627713 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:40.628467 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:40.628962 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:40.629364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:40.790060 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:40.798369 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9b8bc154-9a3c-4d5d-89f6-d64c15854f21 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.184221 Aug 07 19:36:40.799129 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 510/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:40 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:41.567052 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:41.567906 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:41.575232 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:41.575844 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:41.576410 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:41.577446 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:41.578072 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:41.578688 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:41.734773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:41.743596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e38dc607-139b-4a81-befd-963d29a83e27 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1317 microversion: 2.1 time: 0.181893 Aug 07 19:36:41.744277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 523/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:41 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:36:41.819507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:41.820164 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:41.829087 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:41.829854 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:41.830500 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:41.831804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:41.832484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:41.833133 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:42.015764 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:42.027605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5393bea3-5d52-4c0f-a4fe-80f21c9b7758 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.212307 Aug 07 19:36:42.028236 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 511/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:41 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:42.291877 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7815f2aa-de95-41f9-b09f-95407cae1e51 req-3a1215c3-04b5-4640-b345-45137e4f4e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61a8c3-7a93-4057-8c01-88db0e624350", "tag": "f78e6723-916c-40d7-9555-6b30f07333d0"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:42.302463 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7815f2aa-de95-41f9-b09f-95407cae1e51 req-3a1215c3-04b5-4640-b345-45137e4f4e0c service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:42.302941 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7815f2aa-de95-41f9-b09f-95407cae1e51 req-3a1215c3-04b5-4640-b345-45137e4f4e0c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:42.303368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7815f2aa-de95-41f9-b09f-95407cae1e51 req-3a1215c3-04b5-4640-b345-45137e4f4e0c service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:42.315977 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7815f2aa-de95-41f9-b09f-95407cae1e51 req-3a1215c3-04b5-4640-b345-45137e4f4e0c service nova] Creating event network-changed:f78e6723-916c-40d7-9555-6b30f07333d0 for instance 1e61a8c3-7a93-4057-8c01-88db0e624350 on hv-cinder-85032 Aug 07 19:36:42.321210 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7815f2aa-de95-41f9-b09f-95407cae1e51 req-3a1215c3-04b5-4640-b345-45137e4f4e0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259912 Aug 07 19:36:42.321829 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 524/1035] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:42.779046 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:42.780576 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:42.794076 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:42.794951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:42.795690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:42.797130 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:42.797953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:42.798698 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:42.961951 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:42.970148 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9c4ded32-d34c-4474-90e9-45583ca4f14b tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1317 microversion: 2.1 time: 0.198372 Aug 07 19:36:42.970867 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 512/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:42 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:43.055046 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:43.055770 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:43.062762 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:43.063244 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:43.063673 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:43.064438 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:43.064887 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:43.065473 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:43.232136 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:43.240524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b8c3d3b0-9b2f-4947-9337-4ce3c332f2c8 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.190354 Aug 07 19:36:43.241116 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 525/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:43 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:43.993241 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:43.994514 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:44.006604 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:44.007845 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:44.008902 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:44.011014 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:44.012227 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:44.013496 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:44.226594 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:44.237755 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d7c8e172-28c6-45d4-9325-48ec6dd8a98f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1317 microversion: 2.1 time: 0.250384 Aug 07 19:36:44.238586 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 513/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:43 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:44.262847 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:44.263897 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:44.272546 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:44.273239 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:44.273783 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:44.274636 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:44.275289 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:44.276019 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:44.438105 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:44.446995 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7ad36e20-c054-434e-bcce-a8339b56661c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.188854 Aug 07 19:36:44.447689 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 526/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:44 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:45.259121 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:45.259747 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:45.267004 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:45.267392 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:45.267817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:45.268569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:45.269016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:45.269439 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:45.451271 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:45.460031 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0fe38eab-c23b-4d2d-9985-3dc8a5549755 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1317 microversion: 2.1 time: 0.204701 Aug 07 19:36:45.460690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 514/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:45 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:45.468938 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:45.469989 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:45.478406 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:45.479034 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:45.479581 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:45.480484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:45.481053 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:45.481595 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:45.643316 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:45.651777 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7ce2091f-fbd6-4d69-bffc-8ce690772804 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.187069 Aug 07 19:36:45.652516 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 527/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:45 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:36:46.188714 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-199f07eb-523e-4953-a3da-d8c07854c8f5 req-9db92f6e-de00-4d0a-b829-8d87364d603d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61a8c3-7a93-4057-8c01-88db0e624350", "name": "network-vif-plugged", "status": "completed", "tag": "f78e6723-916c-40d7-9555-6b30f07333d0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:46.195908 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:46.208069 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-199f07eb-523e-4953-a3da-d8c07854c8f5 req-9db92f6e-de00-4d0a-b829-8d87364d603d service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:46.208635 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-199f07eb-523e-4953-a3da-d8c07854c8f5 req-9db92f6e-de00-4d0a-b829-8d87364d603d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:46.210338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-199f07eb-523e-4953-a3da-d8c07854c8f5 req-9db92f6e-de00-4d0a-b829-8d87364d603d service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:46.228364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-199f07eb-523e-4953-a3da-d8c07854c8f5 req-9db92f6e-de00-4d0a-b829-8d87364d603d service nova] Creating event network-vif-plugged:f78e6723-916c-40d7-9555-6b30f07333d0 for instance 1e61a8c3-7a93-4057-8c01-88db0e624350 on hv-cinder-85032 Aug 07 19:36:46.234971 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-199f07eb-523e-4953-a3da-d8c07854c8f5 req-9db92f6e-de00-4d0a-b829-8d87364d603d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050846 Aug 07 19:36:46.236309 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 515/1042] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:46.483098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:46.484096 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:46.489987 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:46.498832 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:46.500234 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:46.501070 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:46.502610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:46.503266 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:46.504115 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:46.675077 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:46.675954 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:46.686539 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:46.687477 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:46.687937 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:46.688758 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:46.690174 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:46.690632 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:46.718343 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:46.733774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-caf63b15-e36e-4c72-ae18-747fc48a0fdc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1317 microversion: 2.1 time: 0.255269 Aug 07 19:36:46.734778 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 528/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:46 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:46.858969 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:46.867879 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dacdf1a2-2204-4b6e-b853-db3da004e97a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.197332 Aug 07 19:36:46.868595 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 516/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:46 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:36:47.755624 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:47.756469 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:47.763627 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:47.764270 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:47.764756 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:47.765550 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:47.766138 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:47.766638 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:47.896623 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:47.898847 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:47.911425 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:47.912321 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:47.912899 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:47.913986 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:47.915054 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:47.915823 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:47.968484 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:47.997050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5f05a630-b75c-4d20-b59e-a540c1bbbb1f tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1506 microversion: 2.1 time: 0.244198 Aug 07 19:36:47.999280 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 529/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:47 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:48.064277 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31413141-ce65-419e-b824-c6abcf9e6616", "device": "/dev/sdb"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:48.069552 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:48.078417 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:48.079043 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:48.079627 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:48.080603 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:48.081198 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:48.081555 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:48.187296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:48.191677 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:48.197065 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-af2d8aed-5b25-4c83-9d54-108e802f9d45 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.309390 Aug 07 19:36:48.197666 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 517/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:47 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:36:48.255413 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-4b529dd3-6ef1-4587-acf0-e7df58954c70 req-1d8324ca-d36d-4275-b535-af79b4a95d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "715746ed-7264-4abb-b2f8-e61e66eede32", "name": "network-vif-plugged", "status": "completed", "tag": "0c3fed4f-f5a6-4902-804b-a85c9ead5d85"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:48.271152 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4b529dd3-6ef1-4587-acf0-e7df58954c70 req-1d8324ca-d36d-4275-b535-af79b4a95d69 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:48.271647 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4b529dd3-6ef1-4587-acf0-e7df58954c70 req-1d8324ca-d36d-4275-b535-af79b4a95d69 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:48.272163 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4b529dd3-6ef1-4587-acf0-e7df58954c70 req-1d8324ca-d36d-4275-b535-af79b4a95d69 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:48.293017 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-4b529dd3-6ef1-4587-acf0-e7df58954c70 req-1d8324ca-d36d-4275-b535-af79b4a95d69 service nova] Creating event network-vif-plugged:0c3fed4f-f5a6-4902-804b-a85c9ead5d85 for instance 715746ed-7264-4abb-b2f8-e61e66eede32 on hv-cinder-85032 Aug 07 19:36:48.299976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-4b529dd3-6ef1-4587-acf0-e7df58954c70 req-1d8324ca-d36d-4275-b535-af79b4a95d69 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051042 Aug 07 19:36:48.300710 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 518/1047] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:48.414562 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d10fab30-dd98-4045-bb8a-738b5dc011fc tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "POST /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360282 Aug 07 19:36:48.415236 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 530/1048] 10.222.0.17 () {60 vars in 1323 bytes} [Sun Aug 7 19:36:48 2022] POST /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:36:49.220318 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:49.221477 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:49.228830 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:49.229333 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:49.229776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:49.230512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:49.230971 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:49.231401 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:49.249376 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:49.271834 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:49.385094 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:49.393943 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4e1d3804-2599-4adf-80cb-40a44fbff683 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1265 microversion: 2.1 time: 0.178814 Aug 07 19:36:49.394556 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 519/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:49 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:50.416042 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:50.416825 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:50.419822 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=8 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:50.428790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:50.429554 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:50.430248 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:50.431483 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:50.432378 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:50.433158 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:50.643491 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:50.652082 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a7ac36c8-ebce-4509-8477-dc2b522d5bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1452 microversion: 2.1 time: 0.240403 Aug 07 19:36:50.652687 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 531/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:50 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1452 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:50.673906 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:36:50.674782 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:36:50.682243 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:50.682801 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:50.683283 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:50.684134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:50.684637 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:50.685143 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:50.840604 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:36:50.850309 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4e71aae1-5119-4a10-8d3f-b4b2ec3c6229 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1452 microversion: 2.1 time: 0.181272 Aug 07 19:36:50.851049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 520/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:36:50 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:36:52.978655 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-50351e5a-d214-40a5-9475-73f835e26028 req-406db32a-f2c4-41bb-9a9f-40a6840c488e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "715746ed-7264-4abb-b2f8-e61e66eede32", "tag": "0c3fed4f-f5a6-4902-804b-a85c9ead5d85"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:36:52.989834 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-50351e5a-d214-40a5-9475-73f835e26028 req-406db32a-f2c4-41bb-9a9f-40a6840c488e service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:36:52.990422 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-50351e5a-d214-40a5-9475-73f835e26028 req-406db32a-f2c4-41bb-9a9f-40a6840c488e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:36:52.990931 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-50351e5a-d214-40a5-9475-73f835e26028 req-406db32a-f2c4-41bb-9a9f-40a6840c488e service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:36:53.004173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-50351e5a-d214-40a5-9475-73f835e26028 req-406db32a-f2c4-41bb-9a9f-40a6840c488e service nova] Creating event network-changed:0c3fed4f-f5a6-4902-804b-a85c9ead5d85 for instance 715746ed-7264-4abb-b2f8-e61e66eede32 on hv-cinder-85032 Aug 07 19:36:53.014605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-50351e5a-d214-40a5-9475-73f835e26028 req-406db32a-f2c4-41bb-9a9f-40a6840c488e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115780 Aug 07 19:36:53.014605 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 532/1052] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:37:06.007047 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:37:06.007564 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:37:06.010114 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=11 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:06.010765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=14 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:06.017003 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:06.017488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:06.017913 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:06.018736 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:06.019181 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:06.019599 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:06.107045 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lazy-loading 'services' on Instance uuid 1e61a8c3-7a93-4057-8c01-88db0e624350 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:37:06.195881 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-780db294-9848-408d-bea2-a2b4c6f33eff tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350/os-volume_attachments/31413141-ce65-419e-b824-c6abcf9e6616" status: 202 len: 0 microversion: 2.1 time: 0.192180 Aug 07 19:37:06.196617 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 521/1053] 10.222.0.17 () {58 vars in 1416 bytes} [Sun Aug 7 19:37:06 2022] DELETE /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350/os-volume_attachments/31413141-ce65-419e-b824-c6abcf9e6616 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:37:07.326593 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=9 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:07.327345 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:07.331999 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:37:07.332640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:37:07.340673 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:07.341137 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:07.341570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:07.342318 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:07.342771 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:07.343193 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:07.373010 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:37:07.464833 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-62488e87-54a0-4f04-8db9-5c0ddc6f6dbb tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 204 len: 0 microversion: 2.1 time: 0.138724 Aug 07 19:37:07.465368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 533/1054] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:37:07 2022] DELETE /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:37:07.475928 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:37:07.477247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:37:07.485338 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:07.485822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:07.486296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:07.487008 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:07.487654 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:07.488122 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:07.649740 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:37:07.664348 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9a09a0f9-f1e4-42a3-b5d7-9de9a202dce1 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1512 microversion: 2.1 time: 0.192923 Aug 07 19:37:07.665588 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 522/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:37:07 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:37:08.699105 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:37:08.699798 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:37:08.706747 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:08.707232 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:08.707657 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:08.708391 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:08.708836 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:08.709250 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:08.858350 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:37:08.866601 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-85a1e755-34bd-4e3e-b08f-8cdbd4b6068a tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1512 microversion: 2.1 time: 0.171741 Aug 07 19:37:08.867188 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 534/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:37:08 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:37:09.870586 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-0837ed33-13a4-41d6-bb76-81d548c12682 req-75e4f197-ed94-4eef-8816-83a08946cc13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61a8c3-7a93-4057-8c01-88db0e624350", "name": "network-vif-deleted", "tag": "f78e6723-916c-40d7-9555-6b30f07333d0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:37:09.883119 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-0837ed33-13a4-41d6-bb76-81d548c12682 req-75e4f197-ed94-4eef-8816-83a08946cc13 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:09.883603 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-0837ed33-13a4-41d6-bb76-81d548c12682 req-75e4f197-ed94-4eef-8816-83a08946cc13 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:09.884063 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-0837ed33-13a4-41d6-bb76-81d548c12682 req-75e4f197-ed94-4eef-8816-83a08946cc13 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:09.891346 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:37:09.892453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:37:09.898568 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-0837ed33-13a4-41d6-bb76-81d548c12682 req-75e4f197-ed94-4eef-8816-83a08946cc13 service nova] Creating event network-vif-deleted:f78e6723-916c-40d7-9555-6b30f07333d0 for instance 1e61a8c3-7a93-4057-8c01-88db0e624350 on hv-cinder-85032 Aug 07 19:37:09.903547 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:09.904367 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:09.904930 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-0837ed33-13a4-41d6-bb76-81d548c12682 req-75e4f197-ed94-4eef-8816-83a08946cc13 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037601 Aug 07 19:37:09.905202 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:09.905695 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 523/1057] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:37:09.908330 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:09.909632 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:09.910107 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:09.985519 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8077e19cce64faab6e5d71e3e56880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af90b9767e934addbde86fbe26c72c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:37:09.994188 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ecc4ecfa-f951-49ce-a31c-0e1870a72e36 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 200 len: 1302 microversion: 2.1 time: 0.109703 Aug 07 19:37:09.994797 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 535/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:37:09 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 1302 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 19:37:11.020722 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:37:11.021990 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] [instance: 1e61a8c3-7a93-4057-8c01-88db0e624350] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:37:11.029472 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:11.029978 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:11.030460 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:11.031145 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:37:11.031759 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:37:11.032532 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:37:11.047639 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] HTTP exception thrown: Instance 1e61a8c3-7a93-4057-8c01-88db0e624350 could not be found. Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Request method failure captured: Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 HTTP/1.1 Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BQEicss4kWXACrWkO_SGMPtn4Saugj9GX0QwJ3gGua8p-J3W968ILPOctcMyDXvQUSiBFLWzX_nMhIwQOHHSIy3fSJk2xeBzf4KZsIipyecTljnfrcByjvDLPy6ItkEKP3-Ta20Z5H70rT6MUk_TJWpJke2MSXiimsrVdJhNz-2UWg Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: af90b9767e934addbde86fbe26c72c0a Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1336916753 Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:37:11.049360 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af90b9767e934addbde86fbe26c72c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af90b9767e934addbde86fbe26c72c0a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af90b9767e934addbde86fbe26c72c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af90b9767e934addbde86fbe26c72c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotTestJSON-1336916753 Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: af90b9767e934addbde86fbe26c72c0a Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1336916753 Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotTestJSON-1336916753-project Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: d8077e19cce64faab6e5d71e3e56880d Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotTestJSON-1336916753-project Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 1e61a8c3-7a93-4057-8c01-88db0e624350 could not be found. Aug 07 19:37:11.051036 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '1e61a8c3-7a93-4057-8c01-88db0e624350'} Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e61a8c3-7a93-4057-8c01-88db0e624350 could not be found. Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:37:11.052211 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e61a8c3-7a93-4057-8c01-88db0e624350 could not be found. Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e61a8c3-7a93-4057-8c01-88db0e624350 could not be found. Aug 07 19:37:11.054059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:37:11.056296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] Returning 404 to user: Instance 1e61a8c3-7a93-4057-8c01-88db0e624350 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:37:11.056296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-33f54145-12b9-4865-b38b-aa3ef0a0b591 tempest-VolumesSnapshotTestJSON-1336916753 tempest-VolumesSnapshotTestJSON-1336916753-project] 10.222.0.17 "GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350" status: 404 len: 111 microversion: 2.1 time: 0.037597 Aug 07 19:37:11.056296 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 524/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:37:11 2022] GET /compute/v2.1/servers/1e61a8c3-7a93-4057-8c01-88db0e624350 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:38:29.478041 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:29.478787 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:29.482790 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-324581006", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1892901741", "security_groups": [{"name": "tempest-secgroup-smoke-501637307"}], "block_device_mapping_v2": [{"uuid": "fcd94616-a0b9-4c46-8e35-006de50a1b7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2bbd619-d45a-4365-90a9-8061571047c4"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:38:29.605754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] validate_networks() for [('c2bbd619-d45a-4365-90a9-8061571047c4', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 19:38:30.001696 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 19:38:30.002121 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 19:38:30.002592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 19:38:30.002996 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 19:38:30.003399 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 19:38:30.016412 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:30.016900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:30.017334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:30.018064 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:30.018509 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:30.018921 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:30.037690 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for project bdc0726934c64051b49ed81a2abc5c89. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 19:38:30.042695 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Getting quotas for user 656a586e718543bfb095790441c28fe8 and project bdc0726934c64051b49ed81a2abc5c89. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 19:38:30.119769 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 19:38:30.121911 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcd94616-a0b9-4c46-8e35-006de50a1b7c',volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 19:38:30.266299 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e446124c-1a63-4bef-b550-10c8044f0a7b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.789979 Aug 07 19:38:30.266950 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 536/1060] 10.222.0.17 () {60 vars in 1147 bytes} [Sun Aug 7 19:38:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 19:38:30.275804 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:30.276576 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:30.281403 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-290652d2-4864-4af2-8892-7af936eb291f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:30.282016 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-290652d2-4864-4af2-8892-7af936eb291f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:30.339738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-290652d2-4864-4af2-8892-7af936eb291f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:30.346702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-290652d2-4864-4af2-8892-7af936eb291f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1094 microversion: 2.1 time: 0.072649 Aug 07 19:38:30.347276 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 525/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:30 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:31.368324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:31.368958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:31.376022 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:31.377036 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:31.377368 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:31.377953 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:31.378504 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:31.378935 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:31.456407 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:31.464425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8932c8c1-c293-4f29-8fca-a30afa3bbb78 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1210 microversion: 2.1 time: 0.100894 Aug 07 19:38:31.465324 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 537/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:31 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:32.485539 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:32.486134 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:32.493870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:32.494351 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:32.494799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:32.495497 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:32.495953 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:32.496441 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:32.631776 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:32.639373 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca742fb4-2266-47de-b1cd-5a6b74c50dfc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.157805 Aug 07 19:38:32.639928 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 526/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:32 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:32.688725 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-38fac899-4ae6-4d68-82fc-3e26458fa824 req-1f8f17f6-69b6-4296-b227-607f324bdd27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835b2a45-deaa-4a45-ae0e-9c52cbeb4bea", "tag": "1a4718ee-7738-4f5d-9a54-a24aae63e61f"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:38:32.699566 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-38fac899-4ae6-4d68-82fc-3e26458fa824 req-1f8f17f6-69b6-4296-b227-607f324bdd27 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:32.700104 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-38fac899-4ae6-4d68-82fc-3e26458fa824 req-1f8f17f6-69b6-4296-b227-607f324bdd27 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:32.700535 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-38fac899-4ae6-4d68-82fc-3e26458fa824 req-1f8f17f6-69b6-4296-b227-607f324bdd27 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:32.714768 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-38fac899-4ae6-4d68-82fc-3e26458fa824 req-1f8f17f6-69b6-4296-b227-607f324bdd27 service nova] Creating event network-changed:1a4718ee-7738-4f5d-9a54-a24aae63e61f for instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea on hv-cinder-85032 Aug 07 19:38:32.718781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-38fac899-4ae6-4d68-82fc-3e26458fa824 req-1f8f17f6-69b6-4296-b227-607f324bdd27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034655 Aug 07 19:38:32.719556 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 538/1064] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:38:33.661561 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:33.662220 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:33.670317 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:33.670870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:33.671315 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:33.672034 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:33.672515 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:33.672942 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:33.820019 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:33.827852 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-860c9bb0-bafd-4e8d-8c97-c4607aa05ad5 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.170311 Aug 07 19:38:33.828501 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 527/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:33 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:34.849235 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:34.849956 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:34.858044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:34.858534 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:34.858970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:34.859692 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:34.860187 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:34.860610 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:35.005544 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:35.014425 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-026f6b67-b917-49dd-82fa-10ba1b23af1c tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.169568 Aug 07 19:38:35.015030 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 539/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:34 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:36.035090 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:36.035703 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:36.043256 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:36.043708 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:36.044213 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:36.044905 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:36.045364 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:36.045765 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:36.197660 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:36.206059 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-74b75ffb-408a-4573-ac92-351aab4e2abc tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.174894 Aug 07 19:38:36.206606 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 528/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:36 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:37.227330 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:37.228078 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:37.235097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:37.235580 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:37.236029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:37.236743 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:37.237196 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:37.237731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:37.385364 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:37.397165 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8dc6519f-2778-4233-8310-fcc12231485d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.173491 Aug 07 19:38:37.398021 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 540/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:37 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:38.419799 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:38.420447 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:38.427480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:38.427935 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:38.428417 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:38.429106 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:38.429530 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:38.429968 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:38.575204 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:38.586816 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e44ed57b-83c9-42bc-94e8-699cb916d73e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.171549 Aug 07 19:38:38.587643 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 529/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:38 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:39.608399 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:39.608990 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:39.615937 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:39.616453 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:39.616903 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:39.617565 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:39.618014 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:39.618428 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:39.770776 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:39.779029 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eb15c920-2baa-488e-8651-00594fc9bc9b tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.174595 Aug 07 19:38:39.779587 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 541/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:39 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:40.801031 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:40.801661 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:40.803856 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:40.809700 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:40.810387 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:40.810811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:40.811538 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:40.812250 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:40.812822 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:40.964365 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:40.972583 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-35f25e59-de5e-4ad2-900f-7ebad97802e1 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.175466 Aug 07 19:38:40.973175 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 530/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:40 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:41.993155 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:41.993741 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:41.996497 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:41.996497 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:42.003441 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:42.003955 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:42.004384 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:42.005098 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:42.005596 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:42.006044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:42.151327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:42.159592 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9bb59a62-e058-4fea-965c-38afcf09aa3d tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.170613 Aug 07 19:38:42.160197 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 542/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:41 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:42.744897 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-ff809a5a-0860-45f6-adc3-43c00c7deda6 req-4126f897-7cc2-43c0-aa0e-b87410610af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835b2a45-deaa-4a45-ae0e-9c52cbeb4bea", "name": "network-vif-plugged", "status": "completed", "tag": "1a4718ee-7738-4f5d-9a54-a24aae63e61f"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:38:42.761070 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ff809a5a-0860-45f6-adc3-43c00c7deda6 req-4126f897-7cc2-43c0-aa0e-b87410610af5 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:42.761696 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ff809a5a-0860-45f6-adc3-43c00c7deda6 req-4126f897-7cc2-43c0-aa0e-b87410610af5 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:42.762247 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ff809a5a-0860-45f6-adc3-43c00c7deda6 req-4126f897-7cc2-43c0-aa0e-b87410610af5 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:42.777848 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-ff809a5a-0860-45f6-adc3-43c00c7deda6 req-4126f897-7cc2-43c0-aa0e-b87410610af5 service nova] Creating event network-vif-plugged:1a4718ee-7738-4f5d-9a54-a24aae63e61f for instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea on hv-cinder-85032 Aug 07 19:38:42.783488 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-ff809a5a-0860-45f6-adc3-43c00c7deda6 req-4126f897-7cc2-43c0-aa0e-b87410610af5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178531 Aug 07 19:38:42.784168 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 531/1073] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:38:43.180862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:43.181702 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:43.188276 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:43.188744 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:43.189169 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:43.189862 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:43.190304 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:43.190705 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:43.344599 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:43.356301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-750e5aaa-1798-461c-94cb-34f052749e4a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1265 microversion: 2.1 time: 0.179095 Aug 07 19:38:43.357312 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 543/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:43 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:44.378888 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:44.379478 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:44.386850 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:44.387341 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:44.387780 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:44.388512 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:44.389011 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:44.389451 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:44.527479 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:44.537484 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2c66fa56-bf34-4cba-803f-13ac2ee36cba tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1451 microversion: 2.1 time: 0.163323 Aug 07 19:38:44.549182 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 532/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:44 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:44.559649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:38:44.560533 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:38:44.568203 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:44.568818 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:44.569240 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:44.569958 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:44.570429 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:44.570856 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:44.725162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:38:44.732754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3862a41e-27d2-42e0-b832-74913b7e8d2e tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1451 microversion: 2.1 time: 0.177122 Aug 07 19:38:44.733336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 544/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:38:44 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:38:46.681868 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8d809d17-ccef-40ec-b6a6-ef04b655f1b1 req-ce1619e3-0c5b-4738-8cce-9c43441ce262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835b2a45-deaa-4a45-ae0e-9c52cbeb4bea", "tag": "1a4718ee-7738-4f5d-9a54-a24aae63e61f"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:38:46.694605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8d809d17-ccef-40ec-b6a6-ef04b655f1b1 req-ce1619e3-0c5b-4738-8cce-9c43441ce262 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:38:46.694605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8d809d17-ccef-40ec-b6a6-ef04b655f1b1 req-ce1619e3-0c5b-4738-8cce-9c43441ce262 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:38:46.694605 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8d809d17-ccef-40ec-b6a6-ef04b655f1b1 req-ce1619e3-0c5b-4738-8cce-9c43441ce262 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:38:46.705538 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8d809d17-ccef-40ec-b6a6-ef04b655f1b1 req-ce1619e3-0c5b-4738-8cce-9c43441ce262 service nova] Creating event network-changed:1a4718ee-7738-4f5d-9a54-a24aae63e61f for instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea on hv-cinder-85032 Aug 07 19:38:46.710698 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8d809d17-ccef-40ec-b6a6-ef04b655f1b1 req-ce1619e3-0c5b-4738-8cce-9c43441ce262 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032651 Aug 07 19:38:46.711418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 533/1077] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:39:28.409702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:39:28.410608 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Sun Aug 7 19:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:39:35.903210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:39:35.903210 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Sun Aug 7 19:39:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:39:38.053394 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:39:38.054190 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Sun Aug 7 19:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:40:17.946051 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:17.947745 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=46 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:17.949214 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=20 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:17.950049 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=40 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:17.952038 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:17.952612 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:17.956756 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f6844ff0-009e-41b8-94f6-f25ec4a1617f req-bbf86aa0-67d7-407b-a726-7393e4dd3e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835b2a45-deaa-4a45-ae0e-9c52cbeb4bea", "tag": "1a4718ee-7738-4f5d-9a54-a24aae63e61f"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:40:17.960264 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:17.960759 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:17.961190 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:17.961898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:17.962347 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:17.962968 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:17.970707 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6844ff0-009e-41b8-94f6-f25ec4a1617f req-bbf86aa0-67d7-407b-a726-7393e4dd3e90 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:17.971418 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6844ff0-009e-41b8-94f6-f25ec4a1617f req-bbf86aa0-67d7-407b-a726-7393e4dd3e90 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:17.971848 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6844ff0-009e-41b8-94f6-f25ec4a1617f req-bbf86aa0-67d7-407b-a726-7393e4dd3e90 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:17.982661 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f6844ff0-009e-41b8-94f6-f25ec4a1617f req-bbf86aa0-67d7-407b-a726-7393e4dd3e90 service nova] Creating event network-changed:1a4718ee-7738-4f5d-9a54-a24aae63e61f for instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea on hv-cinder-85032 Aug 07 19:40:17.988465 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f6844ff0-009e-41b8-94f6-f25ec4a1617f req-bbf86aa0-67d7-407b-a726-7393e4dd3e90 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041781 Aug 07 19:40:17.989254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 534/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:40:17.990649 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:40:18.085781 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4d9332c5-f829-4873-bbb7-415476d0a6c4 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "DELETE /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 204 len: 0 microversion: 2.1 time: 0.140656 Aug 07 19:40:18.087587 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 545/1079] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:40:17 2022] DELETE /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:40:18.098099 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:18.099081 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:18.111853 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:18.112323 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:18.112811 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:18.113690 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:18.114249 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:18.114662 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:18.257303 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:40:18.265352 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7df57036-2297-4d7e-8ca0-6d6706462c28 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1576 microversion: 2.1 time: 0.172857 Aug 07 19:40:18.265865 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 535/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:18 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:40:19.288921 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:19.289604 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:19.296943 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:19.297424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:19.297855 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:19.298570 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:19.299004 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:19.299419 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:19.443101 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:40:19.451169 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e31e7121-bfdf-4163-a72a-447de917a4e6 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1576 microversion: 2.1 time: 0.167659 Aug 07 19:40:19.451774 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 546/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:19 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:40:20.472378 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:20.473254 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:20.480849 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:20.481450 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:20.482074 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:20.482866 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:20.483552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:20.484020 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:20.514854 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-6fdcae0f-0223-4146-ada3-a4d483b2c9bc req-ac175e8c-7018-4174-a029-f5d333bd2670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835b2a45-deaa-4a45-ae0e-9c52cbeb4bea", "name": "network-vif-deleted", "tag": "1a4718ee-7738-4f5d-9a54-a24aae63e61f"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:40:20.524773 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6fdcae0f-0223-4146-ada3-a4d483b2c9bc req-ac175e8c-7018-4174-a029-f5d333bd2670 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:20.525243 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6fdcae0f-0223-4146-ada3-a4d483b2c9bc req-ac175e8c-7018-4174-a029-f5d333bd2670 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:20.525729 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6fdcae0f-0223-4146-ada3-a4d483b2c9bc req-ac175e8c-7018-4174-a029-f5d333bd2670 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:20.537130 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-6fdcae0f-0223-4146-ada3-a4d483b2c9bc req-ac175e8c-7018-4174-a029-f5d333bd2670 service nova] Creating event network-vif-deleted:1a4718ee-7738-4f5d-9a54-a24aae63e61f for instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea on hv-cinder-85032 Aug 07 19:40:20.542640 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-6fdcae0f-0223-4146-ada3-a4d483b2c9bc req-ac175e8c-7018-4174-a029-f5d333bd2670 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Aug 07 19:40:20.543293 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 547/1082] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 19:40:20.549480 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:40:20.557343 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b49af479-91e9-4ddb-af28-a496a3092da3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1390 microversion: 2.1 time: 0.089216 Aug 07 19:40:20.557934 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 536/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:20 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:40:21.579170 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:21.579898 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:21.586683 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:21.587168 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:21.587594 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:21.588328 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:21.588793 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:21.589215 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:21.621863 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:21.622327 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:21.622754 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:21.623195 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lazy-loading 'fault' on Instance uuid 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 19:40:21.673500 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:40:21.681656 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-db186fa1-b3ec-42c8-9f52-c123de757ece tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 200 len: 1230 microversion: 2.1 time: 0.107169 Aug 07 19:40:21.682097 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 548/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:21 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:40:22.705758 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:22.706525 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:22.713665 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:22.714177 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:22.714619 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:22.715320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:22.715777 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:22.716284 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:22.730487 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] HTTP exception thrown: Instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea could not be found. Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Request method failure captured: Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea HTTP/1.1 Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BOMR57ykhhFharEKQp2Y3k8meWAqjHrwSfzs9sTTlySe0kPiZfU6elvxWE9M9y-OkCjIfuUe_pxo8VlfU_PGvpRvDzNE2QTAMPlawtgZbML05EUEklBu9mhoeIDnyAFUrHjKYJwBpfh5ZvMAFEhVu7r4h-303oldK4p3w4eb19uLAg Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:40:22.732157 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bdc0726934c64051b49ed81a2abc5c89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 656a586e718543bfb095790441c28fe8 Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea could not be found. Aug 07 19:40:22.733957 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '835b2a45-deaa-4a45-ae0e-9c52cbeb4bea'} Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea could not be found. Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:40:22.734932 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea could not be found. Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea could not be found. Aug 07 19:40:22.736687 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:22.738325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Returning 404 to user: Instance 835b2a45-deaa-4a45-ae0e-9c52cbeb4bea could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:40:22.738325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5893546e-528b-4895-a6fa-c1d8d1260278 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea" status: 404 len: 111 microversion: 2.1 time: 0.033760 Aug 07 19:40:22.738325 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 537/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:22 2022] GET /compute/v2.1/servers/835b2a45-deaa-4a45-ae0e-9c52cbeb4bea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:40:26.100336 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:26.100985 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:26.102507 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-4ac3794c-31c9-442b-913a-6c219ca47017 req-51de8093-5749-46bc-a4f6-e253d197c843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "715746ed-7264-4abb-b2f8-e61e66eede32", "tag": "0c3fed4f-f5a6-4902-804b-a85c9ead5d85"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:40:26.107719 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:26.108237 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:26.108662 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:26.109335 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:26.110026 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:26.110442 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:26.113191 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4ac3794c-31c9-442b-913a-6c219ca47017 req-51de8093-5749-46bc-a4f6-e253d197c843 service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:26.113910 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4ac3794c-31c9-442b-913a-6c219ca47017 req-51de8093-5749-46bc-a4f6-e253d197c843 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:26.114329 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4ac3794c-31c9-442b-913a-6c219ca47017 req-51de8093-5749-46bc-a4f6-e253d197c843 service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:26.126279 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-4ac3794c-31c9-442b-913a-6c219ca47017 req-51de8093-5749-46bc-a4f6-e253d197c843 service nova] Creating event network-changed:0c3fed4f-f5a6-4902-804b-a85c9ead5d85 for instance 715746ed-7264-4abb-b2f8-e61e66eede32 on hv-cinder-85032 Aug 07 19:40:26.132779 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-4ac3794c-31c9-442b-913a-6c219ca47017 req-51de8093-5749-46bc-a4f6-e253d197c843 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Aug 07 19:40:26.133367 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 538/1086] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:40:26.136533 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 19:40:26.229461 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b98ed126-6c42-4960-97af-3f56d8d35bf9 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "DELETE /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 204 len: 0 microversion: 2.1 time: 0.132764 Aug 07 19:40:26.234717 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 549/1087] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:40:26 2022] DELETE /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 19:40:26.241399 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:26.242153 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:26.249738 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:26.251351 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:26.251826 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:26.252702 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:26.253250 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:26.253991 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:26.405186 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:40:26.413768 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c44e4208-a24e-405d-9bd4-50c0b168fd14 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1576 microversion: 2.1 time: 0.177758 Aug 07 19:40:26.414460 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 539/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:26 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:40:27.439950 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:27.440974 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:27.448835 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:27.449307 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:27.449734 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:27.450413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:27.450856 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:27.451268 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:27.591970 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:40:27.601731 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f309aeeb-00bc-40f9-8a54-d6eb81a9cc9a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1576 microversion: 2.1 time: 0.168708 Aug 07 19:40:27.602301 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 550/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:27 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:40:28.433581 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-ef54559c-e1bf-4994-b317-174bd9f0cfa4 req-f64080ae-089a-4764-8b2d-0ced75391adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "715746ed-7264-4abb-b2f8-e61e66eede32", "name": "network-vif-deleted", "tag": "0c3fed4f-f5a6-4902-804b-a85c9ead5d85"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 19:40:28.457700 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ef54559c-e1bf-4994-b317-174bd9f0cfa4 req-f64080ae-089a-4764-8b2d-0ced75391adb service nova] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:28.458174 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ef54559c-e1bf-4994-b317-174bd9f0cfa4 req-f64080ae-089a-4764-8b2d-0ced75391adb service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:28.458559 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ef54559c-e1bf-4994-b317-174bd9f0cfa4 req-f64080ae-089a-4764-8b2d-0ced75391adb service nova] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:28.472212 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-ef54559c-e1bf-4994-b317-174bd9f0cfa4 req-f64080ae-089a-4764-8b2d-0ced75391adb service nova] Creating event network-vif-deleted:0c3fed4f-f5a6-4902-804b-a85c9ead5d85 for instance 715746ed-7264-4abb-b2f8-e61e66eede32 on hv-cinder-85032 Aug 07 19:40:28.478363 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-ef54559c-e1bf-4994-b317-174bd9f0cfa4 req-f64080ae-089a-4764-8b2d-0ced75391adb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048466 Aug 07 19:40:28.478970 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 540/1090] 10.222.0.17 () {64 vars in 1317 bytes} [Sun Aug 7 19:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 19:40:28.625348 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:28.625947 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:28.635334 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:28.635738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:28.636424 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:28.637415 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:28.637870 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:28.638392 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:28.703584 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '656a586e718543bfb095790441c28fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0726934c64051b49ed81a2abc5c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 19:40:28.712206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-077db943-bf07-4cfc-adb3-e6283a8a2d5a tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 200 len: 1225 microversion: 2.1 time: 0.092607 Aug 07 19:40:28.713103 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 551/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:28 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 19:40:29.736569 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:29.737269 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 715746ed-7264-4abb-b2f8-e61e66eede32] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:29.747320 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:29.747976 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:29.748667 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:29.749594 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:29.750240 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:29.750790 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:29.765527 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] HTTP exception thrown: Instance 715746ed-7264-4abb-b2f8-e61e66eede32 could not be found. Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Request method failure captured: Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 HTTP/1.1 Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BOMR57ykhhFharEKQp2Y3k8meWAqjHrwSfzs9sTTlySe0kPiZfU6elvxWE9M9y-OkCjIfuUe_pxo8VlfU_PGvpRvDzNE2QTAMPlawtgZbML05EUEklBu9mhoeIDnyAFUrHjKYJwBpfh5ZvMAFEhVu7r4h-303oldK4p3w4eb19uLAg Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:40:29.767161 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bdc0726934c64051b49ed81a2abc5c89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 656a586e718543bfb095790441c28fe8 Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 715746ed-7264-4abb-b2f8-e61e66eede32 could not be found. Aug 07 19:40:29.768893 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '715746ed-7264-4abb-b2f8-e61e66eede32'} Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 715746ed-7264-4abb-b2f8-e61e66eede32 could not be found. Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:40:29.769911 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 715746ed-7264-4abb-b2f8-e61e66eede32 could not be found. Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 715746ed-7264-4abb-b2f8-e61e66eede32 could not be found. Aug 07 19:40:29.771493 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:29.772968 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Returning 404 to user: Instance 715746ed-7264-4abb-b2f8-e61e66eede32 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:40:29.772968 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e5ca4898-6331-4db1-83a7-28a0cdf69696 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32" status: 404 len: 111 microversion: 2.1 time: 0.039175 Aug 07 19:40:29.772968 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 541/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:29 2022] GET /compute/v2.1/servers/715746ed-7264-4abb-b2f8-e61e66eede32 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:40:30.255673 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:30.256354 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:30.262864 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:30.263351 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:30.263784 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:30.264524 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:30.265054 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:30.265413 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:30.279446 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] HTTP exception thrown: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Request method failure captured: Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf HTTP/1.1 Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept: application/json Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Connection: close Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Length: 0 Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Content-Type: application/json Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Host: 10.222.0.17 Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.11 Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABi8BOMR57ykhhFharEKQp2Y3k8meWAqjHrwSfzs9sTTlySe0kPiZfU6elvxWE9M9y-OkCjIfuUe_pxo8VlfU_PGvpRvDzNE2QTAMPlawtgZbML05EUEklBu9mhoeIDnyAFUrHjKYJwBpfh5ZvMAFEhVu7r4h-303oldK4p3w4eb19uLAg Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Role: member,reader Aug 07 19:40:30.281206 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bdc0726934c64051b49ed81a2abc5c89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Id: 656a586e718543bfb095790441c28fe8 Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: method: > Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: exception: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.282900 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: action_args: {'id': '7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf'} Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:40:30.284050 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.285738 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.287468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Returning 404 to user: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:40:30.287468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8ba5f713-c2aa-4271-be3a-c2505404a66f tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 404 len: 111 microversion: 2.1 time: 0.031011 Aug 07 19:40:30.287468 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 552/1093] 10.222.0.17 () {58 vars in 1239 bytes} [Sun Aug 7 19:40:30 2022] DELETE /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:40:30.292185 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:30.292817 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] [instance: 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 19:40:30.299131 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:30.299614 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:30.300075 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:30.300773 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Acquiring lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 19:40:30.301224 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 19:40:30.301646 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Lock "73f98dc0-20c8-4d82-9362-d3c5a0691040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 19:40:30.316332 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] HTTP exception thrown: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Request method failure captured: Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf HTTP/1.1 Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Connection: close Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Host: 10.222.0.17 Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi8BOMR57ykhhFharEKQp2Y3k8meWAqjHrwSfzs9sTTlySe0kPiZfU6elvxWE9M9y-OkCjIfuUe_pxo8VlfU_PGvpRvDzNE2QTAMPlawtgZbML05EUEklBu9mhoeIDnyAFUrHjKYJwBpfh5ZvMAFEhVu7r4h-303oldK4p3w4eb19uLAg Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 07 19:40:30.317870 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bdc0726934c64051b49ed81a2abc5c89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bdc0726934c64051b49ed81a2abc5c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Id: bdc0726934c64051b49ed81a2abc5c89 Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-868506318 Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Id: 656a586e718543bfb095790441c28fe8 Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-868506318-project Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: method: > Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: exception: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.319552 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: action_args: {'id': '7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf'} Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 19:40:30.320749 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. Aug 07 19:40:30.322408 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 07 19:40:30.323952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Returning 404 to user: Instance 7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 19:40:30.323952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1be4e5a7-1d3b-4cca-8300-88cfbd61df50 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf" status: 404 len: 111 microversion: 2.1 time: 0.031596 Aug 07 19:40:30.323952 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 542/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Sun Aug 7 19:40:30 2022] GET /compute/v2.1/servers/7b3f0e9f-967d-4bf9-a2a6-73faed9e6aaf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 19:40:31.634661 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5d7898cd-4d5c-4e27-9b48-f8bdf05f91a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] Calling method '.version_select at 0x7fd476e31040>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 19:40:31.661568 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5d7898cd-4d5c-4e27-9b48-f8bdf05f91a3 tempest-TestVolumeBootPattern-868506318 tempest-TestVolumeBootPattern-868506318-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1892901741" status: 202 len: 0 microversion: 2.1 time: 0.031433 Aug 07 19:40:31.662329 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 553/1095] 10.222.0.17 () {58 vars in 1263 bytes} [Sun Aug 7 19:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1892901741 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 19:41:17.870044 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:41:17.871016 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Sun Aug 7 19:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:42:48.420634 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:42:48.421410 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Sun Aug 7 19:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:42:55.912328 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:42:55.913108 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Sun Aug 7 19:42:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:42:58.063560 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:42:58.064162 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Sun Aug 7 19:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:43:17.819549 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:43:17.820189 dv-cinder-850320-4-iscsi devstack@n-api.service[117832]: Sun Aug 7 19:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:43:20.241470 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:43:20.242173 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Sun Aug 7 19:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 19:44:37.880523 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 19:44:37.881298 dv-cinder-850320-4-iscsi devstack@n-api.service[117833]: Sun Aug 7 19:44:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!